A DIRECT APPROACH TO THE BISPECTRAL PROBLEM FOR THE 
RUIJSENAARS-MACDONALD g-DIFFERENCE OPERATORS 



MASATOSHI NOUMI AND JUN'ICHI SHIRAISHI 



Abstract. We present a direct approach to the bispectral problem associated with 
the Ruijsenaars-Macdonald q-difference operators of GL type. We give an explicit con- 
" struction of the meromorphic function ip n (x; s\q, t) on T" x T™, which is the solution of 

the bispectral problem up to a certain gauge transformation. Some basic properties of 
ip n (x; s\q,t) are studied, including the structure of the divisor of poles, the symmetries 
tp n {x; s\q,t) — ip n {s\x\q,t) = ip n (x; s\q,q/t), and the recursive structure described in 
£h ! terms of Jackson integrals or q-difference operators. 
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1. Introduction 



< 

In this paper we study the bispectral problem for the Ruijsenaars-Macdonald g-difference 
operators of GL type. Let T™ = (C*) n be the n- dimensional algebraic torus with canonical 
coordinates x = (x\, . . . , x n ). For each r = 0, 1, . . . , n, we denote by Df = D r (x, T qyX \t) 
the Ruijsenaars- Macdonald g-difference operator of order r in x variables with parameter 
t G C; it is defined by 

|i DT = «G>E II SlI T » (r = 0,l,...,»), (1.1) 

m 

summed over all subsets I C {1, . . . ,n} of cardinality r, where T q>Xi stands for the q- 
shift operator with respect to Xi (i — 1, . . . , n). Denoting the dual coordinates by s = 
(si, . . . , s n ), we investigate the joint bispectral problem 

D* f(x; s) = f(x; s) e r (s) (r = 1, . . . , n), 

(1.2) 

%J 1 D s r f(x]s) = f(x;s)e r (x) (r = l,...,n), 

d- , 

for an unknown meromorphic function f(x; s) on T" x T™. Here, for each r = 0, 1 . . . , n, 

e r (s) denotes the elementary symmetric polynomial in s variables of degree r. We also 

write this system (II. 2p of g-difference equations as 

n 

D x (u) f(x; s) = f{x; s) JJ (1 - us<), 

(1-3) 

D s (u) f(x; s) = f(x; s) JJ (1 - uXi), 

by using the generating function D x (u) = J2r=o (~ U Y D x of the Ruijsenaars-Macdonald 
operators. 

It is known by Ruijsenaars [9] and Macdonald [1] that the g-difference operators 
Df,...,D x commute with each other. On the ring C[x] 6n of symmetric polynomials 



in x, they are diagonalized simultaneously by the Macdonald polynomials P\(x\q,t) as- 
sociated with partitions A = (Ai, . . . , A n ): 

n 

D x (u) P x (x\q, t) = P x (x\q, t) J] (1 - ut^q^). (1.4) 

i=i 

It is also known that the Macdonald polynomials P\(x\q,t) = P\(x\q,t) / P\(t s \q,t) nor- 
malized by the values at t s = (t n_1 , t n ~ 2 , . . . , 1) have the duality property 

Px(t S q»\q,t)=P^t S q X \q,t) (1.5) 

for any partitions A, fi of length < n. This duality implies that the function f(x\ s) = 
Px(t s q^\q,t) solves the bispectral problem (ll.3p on the discrete set of points (x; s) = 
(tfq 11 , t 5 q x ) indexed by partitions. 

The bispectral problem (11.31) for the Ruijsenaars-Macdonald operators in complex 
variables is studied by Cherednik in the context of difference Harish- Chandra theory 
P, [2], and by van Meer and Stokman [6] in connection with the quantum KZ equa- 
tions. The existence of meromorphic solutions has also been established by their works. 
In this article, we present a direct approach to the bispectral problem in the region 
\x\\ ^> \x 2 \ 3> • ■ ■ 3> \x n \ and \si\ ^> |s 2 | 3> ■ ■ • \s n \, based on formal solutions of the 
g-difference equations (11.31) of scalar type. In particular we give explicit construction of 
meromorphic solutions, and discuss various properties of solutions, including duality and 
recursive constructions by Jackson integral representations and g-difference operators. 

First, we establish several fundamental properties concerning the joint eigenfunction 
problem with respect to the Ruijsenaars-Macdonald operators acting on x 

n 

D*(u)f(x;s) = f(x;s)H(l-us i ), (1.6) 

8=1 

with s = (si, . . . , s n ) being a given set of complex variables. Set Sj = t n ~ % q Xl (1 < % < n). 
Let Q + = Nai © • ■ ■ © Na n _i be the positive cone of the root lattice of A n _i with simple 
roots ^ = 6i — e i+ i (1 < i < n — 1). We write x x = Y\ i x x \ x~^ = x^ 1 ■ ■ ■ x~ Mn for each 
A* = Y.i^i e Q+, and C(s~ Q +)[{x~ Q +]] = C(s 2 /s 1 ,...,s n /s n „ 1 ){{x 2 /x 1 ,...,x n /x n _ 1 }} 
for short. Let f(x; s) be a formal series solutions for the joint eigenfunction problem 
(jl.6p given by f(x; s) = x x <p(x; s), ip(x; s) = X^eQ + x_m V 9 m( s ) e C(s _<3+ )[[x~ Q +]] having 
the initial term (fio{s) = 1. 

Theorem 1.1 (Theorem 12.21) . (1) Such a series ip(x;s) exists uniquely. (2) For each 
H E Q+ the coefficient ipn(s) G C(s~ Q+ ) is regular at the origin (s 2 /si, . . . , s„/s n _i) = 0. 
(3) Each (fn{s) has at most simple poles along the divisors q k+1 Sj/si — 1 (1 < i < j < 
n;& = 0, 1,2, ....). 

Set ip(x; s) via the gauge transformation 

<p(x;s)= II 7^#%^(x; S ), (1.7) 

l<i<j<n W X i/ lXi > 
2 



where we used the standard notation for the g-shifted factorial (z; q)^ = YlT=o (•"■ ~ Q kz ) 
assuming that |g| < 1. Then (11. 6p is recast as 

n 

L^ s \u)^{x- s) = V(a:; s) - usi), (1.8) 



where 



IC{l,...,n} i6/ 

Bj(x)= J] l -^il -gVfa:i (/ c {!,..., „}). (1.9) 

j:,:;l,r I Xj/Xi <l X il X i 

Since L^ x;s '(u) is invariant under the exchange t •f-)- q/t, we have 

Theorem 1.2 (Theorem 12 ,4p . T/ie series ip(x;s) is invariant under the change of pa- 
rameters t <-¥ q/t. 

Now we turn to an explicit formula for the eigenfunction of (II. 6p . For each n — 1, 2, . . ., 
we denote by M n the set of all strictly upper triangular n x n matrices with nonnegative 
integer coefficients: M n = {6 = (%)™ j=1 G Mat(n;N) | % = (1 < j < i < n)}. For 
each 9 G M n , we define a rational function c n (0; s|g, t) in the variables s = (si, . . . , s„) by 



«)=n n 



fc=2 l<i<j'<fc 



(q£a> k (<>i, a -<>j,a)q Sj / Si] q) g 



n tt (^* + E°>* (e '-°- g '>W**;gk, fc 

'11 11 fo-ej, fc +E„>*(ft,a-»i,.) S ,/ S .-o) fl ' 1 J 

k=2l<i<j<k W { >3/ s, i>'J)9i,k 

where (2; q) k = (z; q) 00 /(q k z; g)^ (k G Z), and 5] a>A; = YZ=k+i- Set 

^^0= e^m?,*) n feMf y ec(^ + )[[x- Q i. (1.11) 

Theorem 1.3 (Theorem 13.31) . We have the eigenfunction equation in x 

n 

D x (u)x x p n (x; s\q, t) = x x p n (x; s\q, t) JJ(1 - us,-). (1.12) 

i=l 

In Section 3, this will be proved by using the property of c n (9;s\q,t) and the theory 
of Macdonald polynomials. We note that an alternative proof which does not rely on 
the Macdonald theory will be presented in Sections 4 and 5 based on a recursive use of 
certain g-difference operators. 

Now we embark on the study of the bispectral problem (11.21) . Let e n (x; s) be a (possibly 
multi-valued) meromorphic function in x, s such that 



Tq,xi&n(%-> s) & n (xj s)sjt , Tq Si e n {x , s) e n (x, s)xit (1 1, . . . , ?7.), 

(1.13) 



and e n (x;s) = e n (s,x). Set 

(p n (x;s\q,t) = TT ^^" 9 K b ( x; s\q,t), (1.14) 

^ n (x; s|g,t) = _[_[ - — - p n (x;g|g,t) 

l<i<j<n 

= TT (gXj/toj; gU (qsj/tsj; g)~ / ■ f) (1 15) 

f n (x] s\q,t) = e n (x; s)ip n (x; s\q,t) £ e„(x; s)C[[s~ Q+ ]][[ar Q+ ]]. (1.16) 
By a recursive use of certain Jackson integral transformations studied in [7], we have 

Theorem 1.4 (Theorem |4.4j) . T/ie series f n (x;s\q,t) is a formal solution of the bispec- 
tral problem hi. 2^1 associated with the Ruijsenaars-Macdonald operators. We have the 
symmetries 

(p n (x;s\q,t) = (p n (s;x\q,t), (1.17) 
<Pn(x;s\q,t)= - — J — ^fn(x;s\q,qt), 1.18 

ip n (x; s\q,t) = ip n (s;x\q,t), (1.19) 
ip n (x; s\q,t) = ip n (x; s\q,q/t). (1.20) 

We can recast the recurrence of the Jackson integrals by that of a certain g-difference op- 
erators. Note that such a class of g-difference operators, called the Ruijsenaars-Macdonald 
operators of row type, is studied in |Sj. Set 

^ t\ ti 9U x< y <n [qxj/xi] q)u, (q "'Xj/x* q)u, 

(1.21) 

Theorem 1.5 (Theorem 15. ip . We have the recurrence relations 

oh +\ - TT {t x n+i/xi\q)ca (qsn+i/ts^q)^ . . 

Wn+l{S, X\q, I) — I I r r \ L -^ 

fj[ {qXn+i/Xi;q)oo {qsn+i/s^qjoc 
■ K^'^^CgSn+l/O^^'^^n+OV'nCs; X\q, t) (n = 1, 2, . . .). 

This provides us with an alternative proof of Theorem 11.41 which does not depend on 
the theory of Macdonald polynomials. 

Finally, let e n (x; s)ip n (x; s\q,t) be our formal solution of the bispectral problem for the 
Ruijsenaars-Macdonald operators, and set 

F n (x;s\q,t) = ] [ (qx^tx^^qSj/ts^^ip^x; s\q,t). (1.23) 

l<i<j<n 

Theorem 1.6 (Theorem 16.51) . The series F n (x;s\q,t) represents a holomorphic func- 
tion on C" _1 x C™ -1 in the variables (z;w) = (zi, . . . , z n -i, Wi, . . . , u> n _i) with Z{ = 
x i+ i/xi,Wi = Si+i/si (i — 1, . . . , n — 1), depending holomorphically on t G C* such that 
F n (x;s\q,t) = F n (s;x\q,t) = F n (x;s\q,q/t). 



As an application of our results, we have a summation formula which can be regarded 
as an infinite series version of the principal substitution of the Macdonald polynomial 
Px(t S \q,t). 

Theorem 1.7 (Theorem I6.6p . Let \t\ > |g|~( n ~ 2 ). We have 



»t£ ii (g/t ; 9)00 i<i:7<n W a *: 



In view of the explicit construction of <^ n (x; s|g, t) as above, one observes that the 
properties stated in Theorems 11.11 and 11.41 are hidden and not evident at all. It seems 
a challenging problem to have an alternative expression of ip n (x; s\q,t) in which such 
properties are manifest. At least the cases n = 2 and 3 can be worked out. The case 
n = 2 is easy and given in (14. lip . 



Theorem 1.8 (Theorem 17.21) . We have 

l/t; q)k(q/t;q 

(g; g)k(*; q)k 



<p 3 {x, s\q, t) = J2 (g f:ti!o g) * (^aM«i)* (1-25) 



fc>0 

^ _ _ I nr -a ■ it • b •• /tm _ [nnr/f/rj riQr/iB, 

(1*1 < 1)> 



X i<S<3 q)ooiqsj/tsi] q) 2<pl 



qXj/tXi, qSj/tSi j, 

I j g> g f 



which manifestly shows the regularity in Theorem and the duality <p 3 (x, s\q,t) = 
<p 3 (s,x\q,t). 

As yet another application, we will revisit the problem considered in [11] , and examine 
some properties of a certain family of integral transformations called 1(a) (a G C) (see 
Section 8). We claim that we have the commutativity [D x (u), 1(a)] = and [1(a), I((3)] = 
0. 

Organization of the paper is as follows. In Section 2, we establish several fundamen- 
tal properties of formal solutions for the joint eigenfunction problem associated with the 
Ruijsenaars-Macdonald operators in the variables x. In Section 3, we study the properties 
of the explicit formulas for the eigenfunction. In Section 4, the recursive structure in the 
explicit formula is investigated from the point of view of the Jackson integrals, which en- 
ables us to study the eigenfunction problem associated with the Ruijsenaars-Macdonald 
operators in the variables s. In Section 5, the recursive structure is recast in yet another 
form based on a recursive application of certain g-difference operators, thereby estab- 
lishing the bispectral eigenfunction problem associated with the Ruijsenaars-Macdonald 
operators in the pair of variables x and s, without relying on the theory of Macdonald 
polynomials. Section 6 is devoted to the study of the convergence of the formal series 
solutions. In Section 7, we treat the case n = 3 and obtain some formulas for the eigen- 
functions in which the duality can be seen manifestly. As an application of our result, we 
study the family of integral transformations 1(a) (a G C) in Section 8. 



Throughout this paper, we fix nonzero constants q,t G C* with the assumption \q\ < 1. 
We use the standard notation of g-shifted factorials 



(z;q)oo = JJ (1 - q k z), (z;q) k 



k=0 



(q k z; q) c 



(k e z), 



(1.26) 



theta function 0(z; q) = (z; 9)00(9/ ' z\ 9)00(9; <l)oo, and Jackson integrals 

f*CL J /*00 J 

/ /(*)^ = (i -?)£/(?*«), / /(*)^ = (!-*)£ /Gr*" lfl )» 

- 70 2 fc=0 ^ z fc=0 

/ = / /(^ + / f{z)J- = (1 - q) £ /(/a). (1.27) 

^0 ./a - 



The basic hypergeometric series r+ i0 r (ai, 02, ... , a r +i; • • • , &r; 9, z) (r = 0, 1, . . .) is de- 
fined by 



r+Wr 



a±, 02, • • • , a r +i 



ra=0 



61, . . . , 6 r 

We also use the notation for the very well-poised series as 
r+ \W r (ai] 04, 05, ... , a r +i; 9, 2) 



(Ql, g)n(fl2, g)n • • • K+l, g)n ^ w 



(q,q)n(bi,q) n ---(b r ,q)r 



1.28) 



(1.29) 



— r +i</v 



1/2 1/2 

Ol, 9*^1 — 9^1 5 ^4; • • • j 

1/2 1/2 



;9,z 



a{ ,—di , 901/04, . . . , qai/a r+ i 
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2. Formal solutions of the eigenfunction equation 
In this section we investigate formal solutions f(x; s) of the eigenfunction equation 

n 

D x (u) f(x; s) = f(x; s) J] (1 - us,) (2.1) 

i=l 

in the variables x = (x\, . . . ,x n ), and prove the unique existence of a formal solution 
f(x;s) with a given leading coefficient. We also establish certain regularity of coefficients 
of f(x; s) with respect to s — (si, . . . , s n ), and symmetry of solutions under the change 
of parameters t -H- q/t. 

We first introduce some notations in order to clarify the meaning of "formal solutions" . 
Let P = Zei © • • • © Ze n be the free Z-module with canonical basis {ei, . . . , e n }, and 
( , ) : P x P — )■ Z the symmetric bilinear form defined by (e^ ej) = 5ij G {1, . . . , n}). 
We denote by 

Q + = Na 1 ©---ffiN« n _ 1 C P (N = {0,1,2,...}) (2.2) 

the cone generated by the simple roots ctj = e, — e i+ i (i = 1, . . . ,n — 1). Under the 
identification P — >• Z n , we use the multi- index notation of monomials 
and g-difference operators T^. = T^J. ■ ■ • T^ n for each /i = ^™ =1 A^ 6 * = • • • ) Mn) e 
so that Tjf x (x w ) = q^ l ' u ^x u for any E P. We use the notations 

C[[x- Q +]] = C[[z 2 /zi,...,x n /x n _i]] and C(a;- Q +) = C(x 2 /x 1; . . . , x n /x n _i) (2.3) 

for the ring of formal power series and the field of rational functions in (n — 1) variables 
x~ ai = x i+ i/xi (i = l,...,n — 1), respectively. When we work with these algebras, 
through the identification Zi = Xi+i/xi (i = 1, . . . , n — 1), we use (a^/xi, • • • , x n /x n _i) as 
a conventional notation for the canonical coordinates z = (z\, . . . , z n _i) of an (n — 1)- 
dimensional affine space C™ -1 . By this convention, we interpret the expression Xj/x, 
(i < j) as representing the monomial ZiZ i+ \ ■ ■ ■ Zj-\. 

2.1. Formal solution with a given leading coefficient. We consider formal solutions 
f(x; s) of ( 12. ip in the form 

f(x;s) = x x tp(x;s), (p(x; s) = ^ x'^cp^s), (2.4) 

where A = (Aj, . . . , A n ) denotes the complex variables such that Sj = t n ~ l q Xi (i = 1, . . . , n). 
As far as g-difference equations are concerned, the power function „ n above 

may be replaced by any function e(x; s) such that T q>Xi e(x; s) = e(x; s)q Xl = e(x; s)si/t n ~ % 
(i = l,...,n). In the expansion (12. 4p of (p(x;s), we assume that all the coefficients 
^p^(s) belong either to the ring C[[s _< ^+]] of formal power series, or to the ring C(s~® + ) 
of rational functions in the variables {s^/sx, . . . , s n /s n -i). The coefficient ifo(s) is called 
the leading coefficient of the solution f(x; s), or the initial value of tp(x; s) at the origin 
(x 2 /xi, . . . ,x n /x n -i) = 0, depending on the situation. 

Theorem 2.1 (Unique existence of a formal solution). Let A = (Ai, . . . , A n ) be the com- 
plex variables such that s, = t n ~ l q Xl for i = 1, . . . ,n. Then, for any c(s) G C[[s~^+]] 
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(resp. G C(s ^ + )), i/iere exists a unique formal solution 

f(x;s) = x x ip(x;s) G x x C[[ S - Q+ }[[x~ Q+ }} (resp. G x x C( S - Q+ )[[x- Q+ }}) (2.5) 
0/ 02. ip with leading coefficient y?o( s ) = c(s). 

Theorem 2.2 (Formal solution with rational coefficients). With the variables A = (Ai, . . . , A r 
such that Si = t n ~ l q Xi (i — 1, . . . , n), let 

f(x;s)=x x <p(x;s)Ex x C(s- Q +)[[x- Q +]}, <p(x;s) = ^ aT^s), (2.6) 

be the formal solution of (12.11) with leading coefficient fo{ s ) — 1- Then, for each fi G Q + , 
the coefficient (pn(s) G C(s _Q +) is regular at the origin (sz/si, . . . , s n /s n _i) = ; and has 
at most simple poles along the divisors 

q k+1 Sj / Si = l (1 < i < j < n; k = 0,1,2,...). (2.7) 

In order to prove these theorems, we rewrite the eigenfunction equation for f(x; s) to 
that of ip(x; s). The g-difference operator 

E^ s \u) = x~ x D x (u)x x (2.8) 

defined by conjugation is expressed explicitly as 

IC{l,...,n} 

II II (/£{!,...,„}), (2.9) 

X tt-' r, I Jjl -L s> I JL"I 

i<j;iel,j£l J ' i<j;i<£l,jel J 



where ej = ^2 ieI £%■ With this g-difference operator, the eigenfunction equation for ip(x; s) 
is given by 

n 

E {x ' s) {u) (p(x; s) = (p(x; s) JJ (1 - u Si ). (2.10) 

i=i 

Note that E^'\u/s{) acts naturally both on C[[,<r Q +]][[ar Q +]] and on C(s -0 +)[[ar <3 +]], 
with the coefficients Aj(x) regarded as elements of C[[x _< ^+]]. 

2.2. Proof of the unique existence. In the following arguments, it is essential to 
transform this equation once more, into the eigenfunction equation for ip(x; s) defined by 

( )= -q jqxj/x^ ^x;s)=J2x-^)- (2-11) 

Note here that (p(x;s) and ip(x;s) have a common leading coefficient; namely, (fo{s) = 
^o(s). We define the g-difference operator L^ ;s ^ by setting 



L^ s \u)= TT ^V^.^oo Eix , s){u) i-r ^■ ^■< oc _ (212) 



By this conjugation, we obtain the g-difference operator 

/C{l,...,n} 

Bi(x)= J] \-_ tx ^ X ^-_ qX ^ tXl (JC {!,..., n}). (2.13) 

i<r,i{ijei Xj/Xi ' ,Xj ' Xi 

It should be observed that the coefficients Bj{x) of L^ x ' ,s \u) depend on t and q/t, sym- 
metrically. We will investigate below the eigenfunction equation 

n 

L^ s \u)^{x; s) = ^{x; s)H (1 - usi), if>(x; s) = £ x~^,(s) (2.14) 

for ^(a;; s). Theorems 12.11 and 12.21 are derived from the following theorems concerning the 
eigenfunction equation (I2.14p . 

Theorem 2.3. For any c(s) G C[[s~^+]] (resp. G C(s~®+)), there exists a unique formal 
solution ijj(x;s) in C[[s~ Q+ ]][[x~ Q+ ]] (resp. in C(s~ Q+ )[[x~ Q+ ]]) of (12.14p with leading 
coefficient ipo(s) = c(s). 

Theorem 2.4. Let ip(x;s) G C(s~ Q +)[[:r~ Q +]] be the formal solution of (I2.14p with 

Ms) = i. 

(1) For each \i G Q + , Vv( s ) G C(s~ Q+ ) is regular at the origin (s 2 /si, . . . , s n / s n-i) = 0; 
and has at most simple poles along the divisors q k+1 Sj/si = 1 (l<i<j<n; fc = 
0,1,2...). 

(2) This formal solution ip(x; s) is invariant under the change of parameters t -h- q/t. 
We remark that the gauge factor can be expanded as 

n % = y n ^/^ecM (2.i5) 

by the g-binomial theorem, where M n denotes the set of all strictly upper triangular n x n 
matrices 9 = (%)"j = i with nonnegative integer coefficients: 

M n = { 9 = (%)™ J=1 G Mat(n; N) | % = (1 < j < i < n)}. (2.16) 

Hence the coefficients y M (s) are expressed as C-linear combinations of t/v(s), and vice 
versa. Theorem 12.41 (1) for ijj(x; s) thus implies Theorem 12.21 for tp(x; s). A characteristic 
feature of ip(x; s) is the symmetry with respect to the change of parameters t -h- q/t; it 
is a consequence from the symmetry of the operator L^ x ' ,s '{u) by the unique existence of 
a formal solution with leading coefficient 1. In the rest of this section, we give a proof of 
Theorem 12.31 and Theorem I2.4[ ( 1 ) . 

By expanding the coefficients Bj(x) in the form 

Bj(x) = x ~^,i e (2.17) 
10 



we rewrite the operator L^ x ' s '(u) as follows: 

L^ s \u)= x-^{u-s-T q , x ), 

b fl (u;s;T q , x ) = (- u ) l \,i seiT q % (^g + ). (2.18) 

/C{l,...,n} 

Note that the leading term of L^ x ' ,s \u) is given by 

n 

b (u; s; T q>x ) = (1 - usiT qtXi ), (2.19) 
i=i 

n 

since b^j = 1 for all / C {1, . . . , n}, and that b (u; s; 1) = J^J (1 — usi) coincides with 

the eigenvalue in (12.141) . By expanding the both sides of (12.141) as formal power series in 
the variables {xz/xi, ■ ■ ■ ,x n /x n -i), we obtain the following recurrence relations for the 
coefficients ip^iu): 

(b (u;s;q->*)-b (u;s;l))iP fl {s)+ £ b u (u; s; q'^^^s) = (// G Q+), (2.20) 

where < denotes the dominance ordering in Q + . 

In order to show the unique existence of a formal solution with a given leading coeffi- 
cient, we use the first order component 

4- = ± s sB{1]{x) Tw b w(x) = fj VJgS:£ff - (2.2D 



of L( x ' s ^(u) = ~S^(—u) r Lr . Note that B^(x) G C[[x 2 /xi, . . . , Xj/xj-i]], and hence 



r=0 



b^{j} = unless /i G Nai + ■ ■ • + Naj_i. The eigenfunction equation for ip(x; s) now takes 
the form 

Lp s) ij(x-,s)=ij(x ]S )(j2sX (2-22) 

V i= i / 

The corresponding recurrence relations for the coefficients Vv( s ) are gi ven by 

{b ,i(s;q- fl )-bo,i(s;i))M s )+ K^q-^n^-vis) = o (2.23) 

0<i/<// 

where 

n 

M*;?" M )-M*;i) = I]*i(?" w - 1 ). 

3=1 

M*5 <T' t+ 1 = 6,, {i} s i g-^ + ^ (0 < v < fj). (2.24) 
i=i 

Noting that &o,i( s i — ^o,i( s i 1)^0 f° r an y /i > as a polynomial in s = (si, . . . , s n ), 

we immediately see that there exists a unique formal solution ip(x; s) G C(s _< ^ + )[[x~^ + ]] 

of ( I2.22p with a given leading coefficient ipo(s) = c(s) G C(s~ Q+ ). 

11 



Supposing that \i > 0, choose the index r such that 

fi = k r a r + • • ■ + fc n _ia n _i, k r > 0. (2.25) 

This condition for r is equivalent to saying that fii = (i < r) and /i r ^ 0. Note that 
H r = k r , fij = — kj-i + kj (r < j < n) and /i n = — k n -\. In this case, for any v G Q + with 
< v < /i, we have v G Na r + • • • + Na n _i. As we remarked already, b Vj yy = unless 
^ G Nqi + . . . + Naj_i. This implies, b V) ^\ = for j = 1, . . . , r. Hence we have 

n 

M«; <r M ) - M«; i) = s r (q-^ - 1) + E s ^ ~ x )> 

j=r+l 

n 

bu,i(s; q-^) = E ^' I ;: •-// " " (° < " < A 1 )' (2-26) 

j=r+l 

and the recurrence relation for Vv( s ) is expressed as 

(Or* - 1) + E(<r w - l)a,A)V>,00 + E (J2 b ^}1^ +U] ^/^-u(s) = 0. 

j>r 0<u<ii j>r 

(2.27) 

Since the coefficient of Vv( s ) is invertible in C[[s~^ + ]] for any fi > 0, this recurrence 
relation implies the unique existence of a formal solution ip(x; s) G C[[s~^+]][|x~^ + ]] of 
( I2.22p with a given leading coefficient V'o(s) = c(s) G C[[s~ Q+ ]]. 

This formal solution ^(x; s) of (IZlZSj) . either in C[[s" Q +]] or in C(s~ Q +)[[x~ Q +)), 

actually solves the joint eigenfunction equation (12.141) with respect to the operator L^ x ' ,s ^ (u) 
Since the operator L^ x ' ,s \u) commute with L^'^, the formal power series (L^ x ' s \u/si) — 
niLi(l ~ uSi/ Si))il)(x] s) is again a formal solution of (12.22ft . However, it must be zero 
by the uniqueness theorem since its leading coefficient is 0. This completes the proof of 
Theorem 12.31 

2.3. Regularity of the expansion coefficients. We now proceed to the proof of The- 
orem [231 (1)- Let ip(x;s) G C(s' Q +)[[x' Q +]] be the formal solution of (jZHJ) with 
i/jq(s) = 1. Then by induction on the dominance ordering, the recurrence relations 

imply that Vv( s ) is regular at (s 2 /si, s n / s n-i) = 0- 111 f ac t, by these recurrence 
relations we can say more about the coefficients i/j^ (s). 

Lemma 2.5. Leti/)(x;s) G C(s _( ^ + )[[x _< ^ + ]] fre the formal solution of f!2. 14j) withipo(s) = 
1. Suppose that fi G is expressed as \i = k r a r + ■ ■ • + fc n _ia n _i /or some r = 1, . . . ,n: 

/iGNa r + --- + N«„_i (r = l,...,n). (2.29) 

JTien £/ie coefficient if> v (s) is a rational function in (s r+1 /s r , . . . , s n / s n-i) regular at the 
origin (s r+1 / s r ,..., s n / s n _ x ) = : 

^(s) G C(s r+ i/s r ,...,s n /s n _i) nC[[s r+1 /s r ,...,s„/v| (2-30) 
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□ 

What remains is to prove that the coefficients Vv( s ) ^ C(s~® + ) have at most simple 
poles along the divisors q k+1 Sj/si = 1 (1 < i < j < n;k = 0,1,2,...). Since ip(x;s) 
is a formal solution of the joint eigenfunction equation f)2.14p . its coefficients satisfy the 
recurrence relations (I2.20p as well: 

(b (u;s;q-»)-b (u;s;l))^(s)+ E K(u; s; q^ +v )^(s) = (ji G Q+). (2.31) 

Q<f</i 

Suppose that \i G Q+ is expressed as /i = k r a r + - ■ - + fc n _ia n _i with k r > 0. In view of this 
recurrence relation, we investigate b v {u\ s; £), £ = (£i, . . . , £ n ), for v G Na r + • — h Na n _i. 

Lemma 2.6. For each v G Na r + • • • + Na n _i, the polynomial b u (u; s; £) is expressed as 

r-l 

b„(u; s; £) = J[ (1 - us^) («; s; 0, (2.32) 

8=1 

where b„ (u; s; £) = 6^(m; s r , . . . , s n ; £ r , . . . , x n ) stands for the corresponding polynomial in 
the case of (n — r + 1) variables (x r , . . . , x n ) and (s r , . . . ,s n ). 

Proof. Recall that these polynomials are determined by the expansion 

E (~u) W s ei Bj(x) C 1 = E x ~ Vh M *\ 0- (2-33) 

IC{l,...,n} v&Q+ 

In order to pick up b v (u] s; £) for v G Na r + • • • + Na n _i, we specialize the x variables 
by setting x^jxx = • • ■ = x r /x r -i = 0. Since Xj/xi = if % < j and i < r, for each 
/ C {1, . . . , n} we have 

1 tec j I CC ^ X QX j j tXi 



B l( X ) \ Xi+1 /xi=0 (i=l,...,r-l) II 



\x i+1 /x i =0 (t=l,...,r-l) 11 1 -xJxi 1 - OXj/Xi 

r<i<j<n;i0,jel 31 * 3 ' 

= B In {r,...,n}{%r, ■ ■ ■ ,X n ), (2.34) 

which depends only on I n {r, . . . ,n}. Hence, for each v G Na r + ■ ■ • + Na n _i, the 
polynomial b u (u; s; £) can be expressed as 

r-l 

M«;«;0= E E (-«) |/UJ| &S^ u 'T /UJ = n( 1 -^)^ ) ( M - s ^) 

/C{l,..,r-1} JC{r,...,n} 1=1 

(2.35) 

by means of the expansion coefficients b^\ in the case of (n — r + 1) variables. □ 
In the setting of ( I2.3ip . by this lemma we have 

r— 1 n n 

&o(u; s; <T") - b (u; s; 1) = JJ (1 - us t ) ( J] (1 - us^) - J] (1 - t^)) , 

j=l j=r j=r 

r-l 

&„(«; s; q->* v ) = \[ (1 - us,) s; <T^). (2-36) 

t=i 
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Hence we obtain the recurrence relation 

n n 

(H (i - usfl-*) - J] (i - u8j))M*) + E 6 ?°(«; s ; r^^OO = °- ( 2 - 37 ) 

Now by setting u = q kr /s r = q^ r / 's r , we can determine ip^(s) as follows: 

n 

JJ (1 - fas/sr))^) = b { jHq kr /s r] s; q-^)^-u(s), (2.38) 

j'=r 0<^</i 

namely, 

*' w = | ( Ffnc^w*''' w (2 - 39) 

Suppose that z/ r = 0, or equivalently v G N« r+ i + • • • + Na n _i. Then by Lemma [27B1 we 
have 

b { j\u; s; q-^) = (1 - us r q~ kr ) b^ r+l \u- s; q-**"), (2.40) 

and hence bl ■(q kr j 's r ; s; q~^ +v ) = by the substitution u = q kr /s r . This means that only 
such v G Q + that have positive coefficients on a r contribute nontrivially in the recurrence 
relation f)2.39p . In other words, we have the recurrence relation 

lf\ ^l v {q k r/s r -s-q- u ) 

W) = 2^ ft TvTP ft k f-^W) 2 ' 41 

0<v<^;l r <k r y * /llj-r+lV "i J/ r ^ 

for each /x G Q+, /i > 0, where k r and Z r stands for the coefficient of a r in the expressions 
/i = k r a r + • • • + /c n _i« n _i (A; > 0) and v = l r a r + • • • + / n _i« n _i, respectively. By 
induction on the dominance ordering, we obtain the following. 

Proposition 2.7. Let ijj(x;s) G C(s _Q+ )[[x _Q+ ]] be the formal solution of (I2.14p with 
ipo{ s ) — 1- Suppose that \i G Q + is expressed as /i = k r a r + • • • + /c n _ia n _i (r = 1, . . . , n). 
Then the coefficient ip^(s) is expressed as 

for some polynomial a M (s) «i £/ie variables (s r+ i/s r , . . . , s n / s n-i)- 

□ 

This proposition is in fact a refinement of Theorem 12.41 (1). 

Remark 2.8. Let us denote by ip n (x;s\q,t) the unique formal solution of (2.14) with 
leading coefficient 1. Express the eigenfunction equation (12.14p in the form 

n 

{-u)Ws ei B I {x)M<l ei ^s\q,t)=t(j n {x ] s\q,t)l[{l-us i ). (2.43) 

iC{l,...,n} i=l 

and specialize this formula by Xijx\ — ■ ■ ■ — x r /x r ^i = 0. From (12.341) it turns out that 
the formal power series ip n {x; s\q, t) \ x . +i/x . =0 (i=lr „ ir _ 1 ) in (x r /x r _i, . . . , x n /x n -i) satisfy 
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the eigenfunction equation ( I2.14p in (n — r + 1) variables (x r , . . . , x n ) and (s r , . . . , s n ). 
Hence by the uniqueness of formal solution with a given leading coefficient, we have 



tfj n (x; S\q, t)\ x , +i/xi=0 (^...^i) = 1pn-r+l(Xr, . . . ,X n \ 8 r , . . . , 8 n \q, t) . (2.44) 



3. Explicit formulas for formal eigenfunctions 

In this section we construct an explicit formal solution of the joint eigenfunction equa- 
tion (12. ip in the form 

f{x; s) = x x ip(x; s), <p(x; s) G C[[ S - Q +]][[x~ Q +]] (3.1) 

with the complex parameters A such that s = t s q x . 

3.1. Formal power series p n (x; s\q,t) and ip n (x; s\q,t). We recall some notations in 
[TU] . For each n = 1, 2, . . ., we denote by M n the set of all strictly upper triangular n x n 
matrices with nonnegative integer coefficients: 

M n = { 9 = (%)" i=1 G Mat(n; N) | % = (l<j<i<n)}. (3.2) 

For each 9 G M n , we define a rational function c n (9; s\q, t) in the variables s = (s%, . . . , s n ) 
by 

x A tt (g Ea > fc(0l ' a ' 9j ' a) ts j /s i ;g) e . fc 

w;sk>*) = ll II t^t — o -e ) — / — 

A tt (q^ k+ ^>^ a - e ^ ) qs j /ts l ;q) e ^ k 

11 11 ( a -«i,h+'Eu >k (fii,a-9 i ,a) s ./ 8 .. a ) t) ' 1 J 

k=2i<i<j<k W b ol b ^ ( i)e l ,k 

where J2 a >k = J2a=k+i- Note that, for each 9 G M n , c n (9;s\q,t) is in fact a rational 
function in (s 2 /si, . . . , s n /s„_i), manifestly regular at the origin (s 2 /si, . . . , s n /s n _i) = 0; 
it can be regarded as an element of C(s" Q +) n C[[s" Q +]]. Note also that c n {6; s\q,t) has 
at most (possibly multiple) poles along the divisors Sj/si = q k (1 < i < j < n; k G Z). 

These functions c n (0; s|g, t) can be determined inductively on n starting from c%(0; si\q, t) 
1. Let us parametrize 9 G M n+ \ by a pair (6 1 , v) G M n x N n as follows: 

hi = 9ij 0- <i < 3 <n), 0i, n+ i = i/, (i = 1, . . . , n). (3.4) 
Then, c n+ i(9; s\q, t) is expressed as 

c n+1 (9,s\q,t) - j! j! (^./^ S ^)- ^ 

Example 3.1. T/ie rational functions c n (9; s\q,t) forn = 2 are given explicitly by 

„ (a . c c i„ ^ (Wfijjkg (q~ 6l2 q/t)e 12 _ (ts 2 /s 1 ;q)e 12 (t;q)o 12 fnM e 13 ,~ ^ 

C2\Vl2, S\, S?,\q, t — ^ r — r r [q t . [6.0) 

{qs2/si;q)e 12 {q 0l2 )e 12 q) 012 {q; q)e l2 
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For n = 3, 

_ (W g iig)fli3 (tS3/si\q)o 13 (ts 3 /s 2 ;q)e 2a 
(qs 2 /s 1 ;q)e 13 {qs 3 /s 1 ;q)e 13 (qs 3 /s 2 ;q)e 23 
. (g~ 0l3 g/*; g) gl3 {q- e ^qs 2 /t Sl ; q) 9l3 {q~ d2A q/t; q)e 23 
{q- 6l3 q;q)e 13 {q- e23 qs 2 /s 1 ;q) ei3 (q- e ™q; q)e 23 

For each n = 1,2,..., we introduce a formal power series 



(3.7) 



p n (x;s\q,t) = Cn(0;s\q } t) n feM) 9,, eC(s- Q+ )[[x^]] (3.8) 

6»eA/ n l<i<j<« 

with leading coefficient 1. For each 9 G M n , define an element fi(9) G Q+ by the formula 
II {xj/xi) *' =x-M\ n{9)= O iJ (e i -e j )eQ + . (3.9) 

l<i<j<n l<i<j<n 

For each \i G Q + , we denote by M n (/i) the subset of M n consisting of all 9 G M n such 
that fi(9) = /x; this set M n (/i) is a finite set for each /i G Q + . Then the power series 
expansion of p n (x; s\q,t) is given by 

p n (x;s\q,t) = ^ x ~^P»i s )i Pv( s )= c n{0]s\q,t) (peQ+). (3.10) 

We also remark that the recurrence relation (13. 5p gives rise to a recurrence formula for 
p n (x;s|g,t): 

„ u. a \„ A - TT-fe^k TT TT {<r Vi+1 Sj/tSi;q) Vi 

Pn+i{x,s\q,t) - ^ Llj—T- 11 f os ./ s .. ) 11 (o-^s/s-o) 

n 

■ JJ (qx n+ i/tXi) Vi p n (x;q~ u s\q,t), (3.11) 
i=i 

where we simply wrote p n +i(£; s|g, t) in place of p n+ i(a; 1 , . . . , s u . . . , s n+ i|g, t) by 
using the same symbols x, s for (n + 1) variables. 

We introduce another formal power series <p n (x; s\q,t) G C[[s _< ^+]][[a; _< ^ + ]] with a dif- 
ferent normalization: 

(p n (x;a\q,t)= | j p w (s;s|g,t) 

Note that y>i(x; s|g, t) = 1. For n = 2, ip 2 (x; s\q, t) is expressed in terms of g-hypergeometric 
series: 

[qs 2 /tsi,q) 00 [qs 2 / Si,q) k [q,q) k 



(qs 2 /s 1 ;q) 00 
{qs 2 /tsi,q) 

oo 
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t, ts 2 /s 1 , 

; q, qx 2 /txi 
qs 2 Si * ' 



(3.13) 



By the definition (13.121) . the leading coefficient of (f n (x; s\q, t) in x variables is 

On the other hand, the leading coefficient as a formal power series in s variables is 
determined by using the recurrence formula (13. lip and the g-binomial theorem: 

<p n (x;s\q,t)\ . nri u = FT ^i*"^ . (3.15) 
rn\ \h, J\ Si+l/si=0 («=i,...,n-i) 1 ^ ft (gar i /te i ;g) 00 V ; 

3.2. Relation to Macdonald polynomials. The definition of the power series p n (x; s\q, t) 
and <p n (x; s\q,t) originates from the tableau representation (or the restriction formula) 
of the Macdonald polynomials. Recall from [4] that the monic Macdonald polynomial 
P\(x\q, t) associated with a partition A = (Ai, . . . , A n ) is expressed explicitly as 

n 

Px(x\q,t)= II ^/^MQ,t) xf k)/ ^ (3.16) 

0=^(°)C ft ( 1 )C---C^(™)=A k=l 

summed over increasing sequences of partitions of n steps form to A, where tpx/^q^) 
is defined for each skew partition A/// (/i C A) by 

W t q )x ^ yr [q 1 q A< _„ 

Note that ip\/^(q,t) = unless A//i is a horizontal strip, namely, /ij > for all z. 

By interpreting the representation (13.161) in terms of column strict tableaux, we denote 
by Oi.j = /4 — [if ^ the number of j's in the z-th row for 1 < i < j < n. Then 
the partitions jj,^ (k = 1, . . . , n) are parametrized by 6 = (9 it j)2j =1 G M n as /i^ = 
Aj — XL>fc ^*,a ^ or 1 < z < Through this parametrization together with S{ = t n ~ l q Xi 
(i = 1, . . . , n), one can directly verify that 



n n 



n^/,N)(?,t)=c# S M), Hx i f )/ ^~ i)i =x x n fo/xo**. (3.i8) 

fc=l fc=l l<i<i<" 

We now take c n (#; s\q,t) for an arbitrary # G M„, and consider the specialization s = 
t s q x by a partition A, assuming that t is generic. Note that the factor (q^ a -> k ^ i ' a ~ 9: >' a Hsj/si; q)g. 
in the definition (13. 3p with j = i + 1 reduces to (g^a>s( e »>«~ e *+i>a)~ A i+ A »+ 1 ; g)^ fc under this 
specialization. Suppose that 

Y[ (gEa> & (^a-e i+1 , o )-A i+ A i+1 . g ^ ifc ^ _ ( 319 ) 
1<«<A;<71 

The factors with k = n then imply JJ (<7 _Ai+Ai+1 ; <?)&;,„ 7^ 0, and hence < 9 i n < 

l<i<n 

Aj — Aj + i (1 < i < n) since Aj > A i+ i. Starting from fc = n, by descending induction on 

k, we see 



< 9 hk <\- A m - (ka - 8i+i,a) = - Hi% 0-<i<k), (3.20) 

a>k 
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which confines 9 in a finite subset of M n so that the monomial x x Yli<i< n ( x j I ' x i) ei ' J remains 
as a polynomial in x. This shows that x x p n (x;t s q x ) = P\(x\q,t) for any partition A = 
(Ai, . . . , A n ), The normalization factor for ip n (x; s\q, t) takes care of the reciprocal of the 
evaluation formula 



l<i<j<n ■> 



n 



Theorem 3.2. Suppose that the parameter t is generic in the sense that t k £ q z for 
k = 1, . . . , n — 1. Then, for any partition A = (Ai, . . . , X n ), the formal power series 
x x p n (x; s\q,t) and x x (p n (x; s\q,t) specialized by s = t 5 q x = (t n ~ l q Xl , . . . ,q x ") recover the 
Macdonald polynomial P\(x\q,t) and a constant multiple of the normalized Macdonald 
polynomial P\(x\q,t), respectively: 

x X p n (x-t 5 q x \q,t) = P x (x; \q,t), 



x x tp n (x; t s q x \q, t) = P x (x\q, t). (3.22) 

f = \ (?/*'; q)oo 

□ 

3.3. Eigenfunction equation in x variables. With the complex variables A such that 
s = t s q x , we consider the eigenfunction equation 

n 

D%u) f(x; s) = f(x; s) J] (1 - usi), f(x; s) = x x <p(x; s) G x x C(s^)[[x^}], (3.23) 

i=\ 

or equivalently, 

n 

E x (u)(p(x-,s) = (p(x-,s)'[[(l-us i ), v{x-s) G C{s- Q+ )[[x- Q+ ]} (3.24) 

i=i 

with leading coefficient <po(s) = 1. This equation is equivalent to an infinite set of 
linear recurrence relations for the coefficients v 9 m( s ) C(s _< ^+) of ip(x;s). When we 
take ip(x; s) = p n (x; s\q, t), we already know these relations hold under the specialization 
s = t 5 q x for any partition A of length < n, since p n (x;t s q x \q,t) coincides with P\(x\q,t). 
This means that each of the recurrence relations holds for arbitrary partitions A, hence 
it holds as an identity of rational functions. Hence we have 

Theorem 3.3. For the complex parameters A with s = t s q x , the formal power series 
x x p n (x; s\q,t) satisfies the eigenfunction equation 

n 

D x (u) x x p n (x] s\q, t) = x x p n (x; s\q, t) JJ (1 - usi). (3.25) 

i=i 

Since x x p n (x; s\q, t) is a formal solution with leading coefficient 1, by Theorem 12.21 we 
know that, for each /i G Q + , the rational function 

P^( s ) = C «(M<?,*) (3-26) 

0eM n (n) 
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has at most simple poles along the divisors Sj/si = (i < j; k — 0, 1, . . .). This 

means that the poles at Sj/ Si = q k with k — 0, 1, 2, . . ., which are apparent in c n (9; s\q; t), 
cancel out after the summation over all 9 G M n (/i). 



3.4. Symmetry with respect to t •f-)- q/t. Let us define a formal power series ip(x\ s) 
by 



p n (x;s\q,t) = ] [ 



l<i<j'<n 



(qxj/xu q) 
(qXj/tXi;q) c 



ip(x;s), ip {s) = 1. 



(3.27) 



Then by Theorem I2.4[ (2), 



(qxj/tx^q) 



c n (0;s|g,t) JJ (zj/ 

1<2<J<?2 



(3.28) 



0eA/ : 



is invariant under the change of parameters t -H- q/t. 



Proposition 3.4. The formal solution p n (x; s\q,t) of (12.101) with leading coefficient 1 
satisfies the symmetry relation 



p n (x;s\q,t) = j J 



l<i<j<n 



(tXj/xi, q^joc 
(qXj/tXi;q) c 



■Pn(x;s\q,q/t) 



(3.29) 



with respect to the change of parameters t <-> q/t. Namely, we have the transformation 
formula 



Cn(8;s\q,t) Yl {xjj 

l<i<j<n 



X i 



9 EM 



n fc'tz?!? e^mwo n (v 



l<i<j<n faifa-'tioo^ 



(3.30) 



l<i<j'<n 



This formula for n = 2 



2^1 



qs 2 /s 1 



q, qx 2 /txi 



(tx 2 /gl)c 

(qx 2 /tx 



2V1 



l oo 



q/t, qs 2 /ts 1 _ 



qs 2 /s 1 



; q,tx 2 /xt 



(3.31) 



is the g-Euler transformation formula for 2 0i- In terms of the formal solution </? n (z; s|g, t), 
the transformation formula mentioned above is expressed as 



ip n {x;s\q. 



n= n 



(txj/x^q)^ (tSj/si,q) c 



l<i<j<n 



(qxj/tx^q)^ (qsj/tsi,q), 



ip n (x;s\q,q/t). (3.32) 



Remark 3.5. In this section, we made use of the explicit formula for Macdonald polyno- 
mials to prove that p n (x; s\q,t) and (p n (x; s\q,t) are formal solutions of the eigenfunction 
equation in the x variables. As we will see in the next section on, however, Theorem 
13.31 as well as Proposition 13.41 can be proved without relying on the theory of Macdonald 
polynomials. 
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4. Recurrence by Jackson integrals 

In this section, we show that the explicit formal solution f(x;s) = x x ip n (x; s\q, t) of 
the eigenfunction equation in x variables essentially solves the bispectral problem 

n n 

D*(u) f(x; s) = f(x; s)H(l- u Si ), D\u) f(x; s) = f(x; s) J] (1 - u Xi ). (4.1) 

i=l i=l 

4.1. Preliminary remarks. Let e n (x; s) be a (possibly multi- valued) meromorphic func- 
tion in (x, s) such that 

Tq )Xi &n{%i 6 n (x, S) Sjt , Tq^ Si €. n (x^ S) 6 n (x, s) Xjt (i 1, . . . , Tl) (4-2) 

and that e n (x; s) = e n (s; x). In order to fix the idea, we choose now the function 

e n {x;s) =g££=iMi ? (4.3) 

defined in terms of additive complex variables ) and A = (A, . . . , A n ) such 

that Xj = t n ~ l q K \ Si = t n ~ l q Xi (i = 1, . . . , n). From the relation x = t 5 q K and s = t 5 q x , we 
have 

e n (x; s) = x x t~ {s ' x) = s K r {5 ' K) . (4.4) 

We remark that the function 



1=1 



defined by theta functions is an alternative choice for e n (x; s). 

We regard (p n (x; s\q,t) as a formal power series in (x 2 /xi, . . . , x n /x n -\ \ s 2 /si, . . . , s n / s n _i): 

<p„(a?;a|?,f) = ^ rt-VeC^l^]]. (4.6) 

Our goal is to show that the formal power series 

f n {x;s\q,t) = e n (x;s)ifi n (x;s\q,t) 6e„(i;s)C[[i^]][[,f 0+ ]] (4.7) 

is a solution of the bispectral problem (14. ip . Since e n ( t ' ' we already know 

that / n (x; t) is a solution of the eigenfunction equation in x variables. We need to 
show that this formal power series simultaneously solves the eigenfunction equation in s 
variables. For that purpose we will make use of the inductive construction of eigenfunc- 
tions by Jackson integrals. 

Before investigating the general case, we observe the case n = 2 in some detail. Recall 
that 



(p 2 (x;s\q,t) = - — 2 <pi 



oo 

oo 



t, ts 2 /s 1 _ 



, q, qx 2 /txi 
qs 2 /si 1 



(qs 2 /ts 1 ;q) 

(qs 2 /s 1 ;q) OQ y, (t;q) k (ts 2 /s 1 ;q) k k 
(qs 2 /ts 1 ;q) 00 {qs 2 /s 1 ;q) k (q;q) k 2 1 
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This series defines a holomorphic function on the domain \qx 2 /tx\\ < 1 and qs 2 /ts\ ^ q N . 
Suppose that \t\ < 1. Then by 

(t;q) k (t;q)oc(q k+1 s 2 /s 1 ;q) 00 (*;?)«» (qs 2 /ts 1 ; q)i Ml 

2^ („-„\, q ^ (49) 



(qs 2 /s 1 ;q) k (qs 2 /s 1 ;q) 00 (q k t;q) 00 (qs 2 /s 1 ; q)oo^ (<?;<?) 



we have 



(qs 2 /tsi; g)oo ^ (g; g), (g;g) fc 

(*;?)oo (qs 2 /tsi, q)i (q l+1 x 2 s 2 /x 1 s 1 ; q)^ ^ 



(qs 2 /ts 1 ;q) OQ (q;q)i (q l+1 x 2 /tx 1 ; g) c 

(t; q)oo(qx 2 s 2 /x 1 s 1 ; g)^ (qs 2 /ts 1 ; q)i(qx 2 /tx 1 ; g)^ 



(qs 2 /tsi, q) 00 (qx 2 /tx 1 \ q)^^ (?l ?)i(?Wii«i; ?)i 



Hence 



/ , . N (^;g)oo(g^2s 2 /a;iSi;g), 



qx 2 /tx 1 ,qs 2 /tsi_ 
qx 2 s 2 /x 1 s 1 



(\t\<i). (4.n; 



(qx 2 /txi, q) OD (qs 2 /ts 1 ; q) c 

This expression represents a meromorphic function in (x 2 /xi, s 2 /si) G C x C at most 
with simple poles at qx 2 /tx\ G g~ N and qs 2 /ts\ G g~ N . Furthermore ip 2 (x; s\q,t) is 
manifestly symmetric with respect to x and s variables. This immediately implies that 
the meromorphic function f 2 (x; s\q, t) = e 2 (x; s)<p 2 (x; s\q, t) actually solves the bispectral 
problem. See [121 Proposition 5.4] also. 

For general n, it is a challenging problem to find an analytic expression that directly 
implies symmetry between x and s variables; the case n = 3 will be studied explicitly 
in Section 7. In the following, we will show that f n (x;s\q,t) satisfies the eigenfunction 
equation for s variables by means of the Jackson integral representation. The symmetry 
with respect to x and s variables will be derived as a consequence of the fact that it 
satisfies the two eigenfunction equations simultaneously. 



4.2. Recurrence by Jackson integrals. In order to prove that f n (x; s\q,t) = e n (x; s) 
Xip n (x; s\q,t) satisfies the eigenfunction equation in s variables, by exchanging the roles 
of x and s variables we show that 

f n (s] x\q, t) = e n (s\ x)(f n (s\ x\q, t) (4.12) 

satisfies the eigenfunction equation in the x variables. For the proof we make use of 
a result of [7j concerning the integral representation of eigenf unctions for Ruijsenaars- 
Macdonald operators. We remark that the method of [7J is applicable to our formal 
setting as well, since it is based on the g-difference equation satisfied by a kernel function. 

Let g(y) be a joint eigenfunction of Ruijsenaars-Macdonald operators in n variables 
y = (yi, . . . ,y n ) such that 

n 

Dy(u)g(y) = g(y) JJ (1 - ut^q**) (4.13) 
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with complex parameters A = (Ai, . . . , A n ). Then, for m > n, we define a function f(x) 
in m variables x = (x\, . . . , x m ) by an integral transformation of the form 

f(x) = J H K (x;y)g(y)du(y) (4-14) 

with a complex parameter k, where du(y) is a g-invariant measure on T™. We choose the 
kernel function so that 

where = means that the both sides coincides up to multiplication by a quasi- constant, 
namely, by a g-periodic function in all variables Xj and yi. Note that H K (x; y) is essen- 
tially the Cauchy kernel (with y variables reversed) multiplied by the weight function 
of orthogonality for Macdonald polynomials. We assume that the integral (I4.14p makes 
sense and that the actions of T q)X . (j = 1, . . . , m) commute with the integral. Then, it is 
known by [7] that f(x) is as well a joint eigenfunction in x variables and satisfies 

m 

D x (u)f(x) = f(x)H (1 - ut m -V J ), (4-16) 

3=1 

with additional parameters Xj = k (j — n + 1, . . . , m). 

We apply this integral transformation to formal power series, in the case where m = 
n+1 and k = A n +i. For that purpose, we rewrite (14.141) in terms of ip(y) and <p(x) defined 
by 

g(y) = y! 1 ---yn n i>(y), /(*) = ^ ■ --^V^), (4.17) 

respectively. Then <p(x) should be obtained from ip{y) by integral transformation 



<p(x) = J K x (x;y)^(y)du(y) (4.18) 

with a kernel such that 

K x (x; y) = x^ Xl ■ ■ ■ x~ x ^H Xn+1 (x; y)y Xl ---y^ 

-nn|#^ n ^&n^-^- (4.19) 

i=l j=l ^ X 3< yu q)o ° l<i,j<n;ifr 1 Vl/ q)co i=l 

Multiplying the right hand side by the quasi-constant 

II It'T ^ g ? fl (Vi/Xi^iq/t)"*-^^, t = qt>, (4.20) 

we choose the function 

j( f x . y\ _ TT (tXj/yj; q)^ -r-r (tXj/yj, q)^ -r-r (gyj/xf, q)^ 
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with parameters A = (Ai, . . . , A n+ i) for our kernel; a power of q/t is introduced for the 
sake of normalization. Noting that this function has zeros at = q k txi (i — 1, . . . , n; k — 
0, 1, 2, . . .), as the g-invariant measure we make use of the Jackson integral 

^^Erll^^-^t- (4 - 22) 

Then, by the argument of [7] applied to formal power series, we can formulate the following 
inductive construction of formal eigenfunctions. 

Lemma 4.1. Let 

V>(z;s) € C[[x- Q+ ]}[[s' Q+ }}, (x;s) = {x u . . . ,x n ;s u . . . ,s n ) (4.23) 

be a formal power series such that g(x; s) = e n (x; s)ip(x; s) is a formal solution of the 
eigenf unction equation (12.11) in n variables ) . Define a formal power series 

<p{x;s) e C[[x- Q +]}[[s- Q +}], (x;s) = {x u . . . , x n+1 ; Sl , . . . , s n+1 ), (4.24) 

by the Jackson integral 

<pi?\ s) = 7T^- n r ■ ■ ■ r k ^ y) *(v> s ) (4.25) 

{^-QrJtxr Jtx n Vl Vn 

where K\(x\ y) is the kernel defined by (14.2 ip with complex parameters A = (Ai, . . . , A n +i) 
such that Si = t n+1 ~ l q Xi (i = 1, . . . ,n + 1). Then f(x; s) = e n+ i(x; s)ip(x; s) is a formal 
solution of the eigenfunction equation in (n + 1) variables x = (x±, . . . , x n+ i). 

□ 

The Jackson integral (14.251) is in fact an n-tuple sum of the values of the integrand at 
the points 

(y 1 ,...,y n ) = (q-^Hx 1 ,...,q-^-Hx n ), v = (i/ x , . . . , v n ) G N". (4.26) 
It is expressed as 

ip{x;s) = ^ K x (x;q- u tx/q)ijj(q~ u tx/q;s) 

(<?;<?)oo V t-t (qxj/xuq)oo 



n 



(q/t; g)oo/ ^^h-i (qxj/txi; g)oo 

TT (gAj_gk TT (qxj/tx^q)^ yf (Q~ Vjtx j/ x i\Q)ui 
~f -f-, (q;q)u (qxj/xi] q) v . (q~ v iXilxi\q) v * 

i=l l<i<i<n W Xj/X^qjoo 

where ip(q~ u tx/q; s) is replaced by ip(q~ u x; s) by using the homogeneity of ^(x;s). 



In view of Lemma l4.1[ starting from x|g, t)=l, we define a sequence of formal 
power series 

n (s-x\q,t) eCllx- Q +]][[s- Q +]], (x;s) = (x l ,...,x n ;s 1 ,...,s n ) (n=l,2,...) (4.28) 
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inductively by 

(j) n+ i(s;x\q,t) 

(qxj/xi;q) c 



n 

l<i<j<n+l 



(qxj/txi; q) 



TT (q/t\ q) Vi tt (qXj/tXi;q) Vi y-r (q u Hx j /x i ;q) l 

< J 11 I rf rt\ 11 i riT ■ t ■ ■ n \ 11 



Then we obtain a sequence of formal solutions 

e n (x;s)0 n (s;s|g,t) G e n (a;; s)C[[ar Q +]][[ S - Q +]] (4.30) 

of the eigenfunction equations (12. ip in x variables. By the g-binomial theorem, we can 
determine the leading coefficient of n (s; x\q,t) inductively as 



(f> n (s;x\q,t)\ . nri u = FT fr'( g " g)o ° . (4.31) 



In view of Theorem 12.41 (2), we introduce 

M*;*M= II (ggj - /to<;g)<w (faj - /a " g)o ° ^( 8 ;x|g,t) (n=l,2,...) (4.32) 

so that ^n( s ; ^l?) has leading coefficient 1 in x, and becomes invariant under the change 
of parameters t •f-)- q/t. We rewrite the recurrence formula (I4.29P for 4> n (s; x\q, t) into that 
for ip n (s;x\q,t): 

i t I ,\ TT {ts n +i/si;q)oo ^ A {q/t;q) Ui -i-r {qxj /tXj] q) Ui 
^ n+1 (s;x\q,t) = [[ -——— ^||-— — || {qx ., x , q) 

■ n ^^CT^ n^Ao^n^ig-^k.t). (4.33) 

l<i<j<n ^ J ' i=l 

By the symmetry of ip n (s; x\q, t), we can exchange t and q/t so that 

i/) +i(s- x\g t) — TT ^ qSn+i ^ Si ' ,q ^ o ° tt TT ^ x il x ^ i)^ 
t\ (qsn+i/si; g)oo ^ fi (?; i<iin + i (<^M; 

JJ (g^M; gk -q {qa /ta .^ M8] q -» x \ q t)m (4.34) 
aj. g, v 3%~ Xi\q) v . - LJ - 

By comparing this with the recurrence formula (13. lip for p n (x; s\q, t), we conclude that 

Ms;x\ q ,t)= TI (^M^)oo ^ ^ 
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with the role of x and s variables exchanged, and hence 

(j) n {s;xq,t = - — J — r jf— —p n {s;xq,t) 

l<T<j<n {IXj/teiiVoc {tSj/Suq)^ 

n(qsj tSi, q)oo i I , \ / . qc n 

(V*;g)oo y " (a;xM - ( 36) 

This shows that e n (a;; s)(p n (s; x\q, t) is a formal solution of the eigenfunction equation 
(12. ip in x variables. It also turns out that 

/ / i j.\ TT (q s j/tSi] q)oo i I ,\ 
V>n{s;x\q,t) = — p n {s;x\q,t) 

= TT {qXj/tXi-q)^ (ggjAgi[g)oo / ■ a / 4 37 x 

i<r<j<n (^jM; 9)oo (gsj/si;g)oo 

is invariant under the change of parameters t <H- q/t, which reproves the transformation 
formulas (153911 and (|X32]1 . 

Theorem 4.2. T7ie sequence of formal power series (p n (s; x\q, t) (n=l,2,. . . ) satisfies the 
following recurrence relation by Jackson integral transformations: 

(q/t] q) 00 Vtt (tSn+i/ Si] q) 00 



< 1 + \ ( (gA;g)°o Ytt 



J (qs n+1 /tSi;q) c 



00 



Jf^yJ^jylg,*)^...^ (4.38) 

tail ^/tln 2/1 2/™ 

where K\(x; y) is the kernel defined by ( 14.2 lj) . 

□ 

This Jackson integral transformation corresponds to the following recurrence formula for 
y? n (s;x|g,t): 

" +1 ' ' (gSn+l/Si! ffJoo^^in+i (q x j / tx i] q)oc 

_ TT (gAj gk TT (qXj/tXi] q) Vi (q-^tXj/xf, q)„. 
^ (q;q) u [qxJxi,q) v . (q~ v ixJxi,q) v . 

■n<«*«/«r n T^Sy -^- (439) 

8=1 l<«<i<" v J/ 7 1 

Theorem 4.3. For eac/i n = 1,2, . . ., the formal power series 
f(x; s) = x x ip n (s;x\q,t) 

= x x J] (9V^;g)oo pn(8;a .| g>t) g a: A C[[x-Q + ]][[ g -Q + ]] (4.40) 
(.qXj/t Xi, q)oo 

defined with parameters X such that s = t s q x is a formal solution of the eigenfunction 
equation (12. ip m x variables. 

□ 
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4.3. Formal solution of the bispectral problem. In Theorem 13.31 and Theorem FO 
we proved that x x (p n (x; s\q, t) and x x <p n (s; x\q, t) satisfy the eigenfunction equation in 
the x variables, respectively. As we already remarked in Section 2, y? n (x; s\q, t) has the 
leading coefficient 

<p n (x;s\q,t)\ , nri u = TT \ qXi { X " q) °° (4.41) 

in s variables. This means that the two formal solutions x x ip n (x; s\q,t) and x x <p n (s; x\q,t) 
of the eigenfunction equation in x variables have the same leading coefficient 

II 

l<i<j<n v J ' ' 



Hence by Theorem 12.11 we see <p n (x, s\q, t) and <p n (s,x\q,t) coincides as formal power 
series in C[[ar +]][[s~°+]]. 

Summarizing these arguments, we have 

Theorem 4.4. Let e n (x; s) be a solution of the q-difference equations (14. 2 j) with symmetry 
e n (x; s) = e n (s; x). Then 

f n (x;s\q,t) = e n (x;s)<p n (x;s\q,t) 6e„(i;s)C[^ 0+ ]][[,r 0+ ]] (4.43) 

is a formal solution of the bispectral problem (14. ip . The formal power series ip n {x] s\q, t) 
have leading coefficients 

<Pn&s\q,t)\ = H 



\ Xi+1 / Xi =o (i=i,...,n-i) 11 ( qSj /tSi;q) c 

{^Xj/xi^q)o 
(qxj/tXi] q) c 



<p n (x;s\q,t)\ , nri ,,= 17 fe^i^- , (4.44) 

^"V i 113 / ls i+ i/ s i=° (*=l,...,n-l) 11 (nr J+'r - ^V_' 



Ki<j<n 

eac/i o/ which determines the formal solution uniquely. It has symmetry 

(p n (x;s\q,t) = <p n (s;x\q,t) (4.45) 
between x and s variables, and transforms as 

i i j.\ TT [tXj/Xijqjoo [tSj/Si^qjoo . . . . . . 

W s ?.* = II 7 tt 7-7 TT v— ¥?n(ac;s g,g/t). 4.46 

i<i<j<n \.9Xj/iXi\ q)oo {qSj/tSi- q)^ 

under the change of parameters t <H- q/t. 

□ 

From the symmetry <p n (x',s\q,t) = (p n (s;x\q,t), it turns out that the formal power 
series i/j n (x; s\q, t) of (14.371) has symmetry i/j n (x] s\q, t) = i/) n (s; x\q, t) as well. Namely, the 
formal power series 

if i i \ TT [qXj /tXi, q)oo i I ,\ 
ip n {x] s\q,t) = II —p n [x;s\q,t) 

{q x j/ x i'-,q)°a 
l<i<]<n v ■" ' 

= II CT7^=E*W •!«■«) II (V*.)- 

l<i<j<n i,q) °° 6eM n l<i<j<n 
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satisfies 

ip n (x;s\q,t) = ip n (s;x\q,t) and ip n (x; s\q, t) = ip n (x; s\q, q/t). (4.48) 

We will prove later that this ip n (x; s\q,t) represents a meromorphic function on C n_1 x 
C n_1 with coordinates (x^/xi, . . . , x n /x n -i; 8%/ s\, . . . , s n /s n _i) at most with simple poles 
along 

q k+1 Xj/xi = 1, q k+1 Sj/si = 1 (1 < % < j < n; k = 0, 1, 2, . . .). (4.49) 

5. Recurrence by ^-difference operators 

In the previous section, we described the inductive structure for ip n (x;s\q, t) (n = 
1,2,...) in terms of Jackson integrals. The inductive structure of <f n (x; s\q, t) can be 
reformulated as recurrence by Ruijsenaars-Macdonald operators of row type. By us- 
ing this fact, we give an alternative proof of duality and bispectrality of f n (x;s) = 
e n (x; s)<f n (x] s\q, t) which does not rely on the theory of Macdonald polynomials. We 
also present an explicit formula for <p n (x; s\q,t) which manifestly shows (a part of) sym- 
metry between x and s variables. We first recall from [8] the definition and some basic 
results on the family of Ruijsenaars-Macdonald operators of row type. 

5.1. Ruijsenaars-Macdonald operators of row type. For each / = 0,1,2..., we 
introduce the following g-difference operators iff of row type: 

«?= E II II 7^rU T ^ («) 

v£N n ; \u\=l l<i<j<n 1 3 l<i,j<n W *' ^ H,v ^i=\ 

It is known by [8J that these operators satisfy the Wronski relations 

(-!)*(! - *VW#? = (k = 1, 2, . . .). (5.2) 

i+j=k 



From this fact, it turns out that each Hf belong to the commutative ring C[Df , . . . , D*} 
of Ruijsenaars-Macdonald operators. Hence we see that the operators Hf commute with 
each other, and that they commute with the operators (r = 1, . . . , n): For all k, I = 
0,1,2,..., 

HZHT = H?HZ, H*D? = D?H*. (5.3) 
In terms of the two generating functions 

n oo 

D x {u) = {-u) r D x r) and H x {u) = ^u l Hf (5.4) 

r=0 1=0 

for Ruijsenaars-Macdonald operators of column type and of row type, the Wronski rela- 
tions above can be written as 

D x {u)H x {u) = D x {tu)H x {qu). (5.5) 

From this relation, it follows that if f(x; s) satisfies the eigenfunction equation 

n 

D x (u)f(x;s) = f(x;s)l[(l-us l ), (5.6) 

i=i 
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then it satisfies 

(tusi, q) 



H x (u) f(x; s) = f(x; s) J] ^ ^ . (5.7) 

We remark that the operator H x (u) can be rewritten in the form 
HX{u)= i-r (qxi/xy, q) ^^-i^TT 

"j r (tXj/xj] q) Vi (q V: > +l Xi/txfq) Vi ^ v -i-r (qXj/txf q)^ 

For each g-difference operator 

A x = A(x; T q _ x ) = £ 4(i)T;eC(x)[ra, (5.9) 

vGN; \u\<m 

we consider the g-difference operator 

A'- 1 = A{x-\T~£) = Mx-'K: (5.10) 

obtained from A x by inverting the variables Xi (i = 1, . . . , n). As for Ruijsenaars- 
Macdonald g- difference operators of column type, one has 

D ^ = t in-Dr ( r = 0| l l ...,n). (5.11) 

Hence we see the commutative ring C[Df, . . . , D x _ x , (-D^) 1 * 11 ] of Ruijsenaars-Macdonald 
operators is stable by the operation A x A x . By using this fact, one can show that 
the eigenfunction equation (I5.6P implies 

n 

D x ~\u) f(x; s) = f{x- s) J] (1 - f^u/si), (5.12) 



i=l 



and hence 



namely, 



^u) /(*;,) =fMU p^ , (5,3) 



Vf*" 1 ) /(*; s) = f(x; s) f[ ( 5 .14) 

As we have seen in Section 1, it is convenient to transform the eigenfunction equation 
for f(x; s) into the equation for ip(x; s) defined by 



f(x;s)=x" I I fajfaq)" ^ s) (5.15) 

i<i<7<n Wto 4 ;?)c- 



with parameter A such that s = t s q x . Then the equation (I5.14p for f(x; s) is rewritten as 

K^\u) ^(x; s) = ^(x; s) f[ Mfl^k, (5.I6) 
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where 

k^ s \u)= TT ^ a-A^-Vu/f-y rr (gV^;g)~ (517) 

Form ( 15. 8p . this operator A^'^ (w) is determined as follows: 

^ Z-^llw t; 11 11 ( qx / Xi - q ) (q-^Xj Xuq) u . q ' x 

(5.18) 

We also use the notation i^'^l"?-') for this operator when we need to specify the parameter 
t. 

5.2. Recurrence by g-difference operators. Let us consider the sequence of formal 
power series 

Ms;x\q,t)= n iplp^p n ( S ;x\q,t) (n = l,2,...) (5.19) 

l<i<j<n J 

so that 

Vn(s;x)= II 7 T- —7 7- r— (s X \q, t . 5.20 

l<i<i<n ( qX i' tXi 'i q >°° (l S j/ tS i^ Q)oo 

In Section 3, by the inductive construction by Jackson integrals, we proved x x ip n (s; x\q, t) 
with s = t 6 q x solves the eigenfunction equation ( 15. 6 p in x variables for n = 1, 2, . . .. Note 
that tfj n (s; x\q,t) has leading coefficient 1 both in x variables and s variables, and hence 
we already know that ip n (s; x\q, t) = ip n (s; x\q, q/t) for all n — 1, 2, 

An important observation is that the recurrence relation for ip n (s; x\q,t) 

f=l (? W*il <Z)oc ^ il (9! l< 4 < A in + l ^i/^ <^ 

• n [( \ "\/ i ' ! : ,r ' :qh ' n g~^k, *) (5.21) 

can be described in terms of the g-difference operator K^ x '^ q,t \u) defined by (15.181) above. 
Note that this recurrence formula follows directly from that of p n (x; s\q,t) in (13. lip by 
the definition (I5.19p . Also, we remark that this formula with t and q/t exchanged arose 
naturally in the previous section from the Jackson integral representation. In fact, the 
recurrence relation (I5.2ip can be expressed as 

, / I ,\ TT (f x n+l/ x i\ Q)oo (Q s n+l/t s i'i Q)oo 

1p n+ l{S; X\q, t) — I I r -, r 

fj^ {qXn^/Xi-qjoo {qs n+1 / suq) oo 

■ K^\qs n+l /t) f[ [l^^ Ms; x\q, t). (5.22) 

\<- J'n ~ \ I J'i; Q)oc 

By using this expression, we can show the duality relation ip n (x; s\q,t) = if) n (s; x\q,t) 
for ip n (s;x\q,t) (n — 1,2, .. .) by the induction on n starting from if;i(s;x\q,i) = 1. We 
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suppose that i/j n (x] s\q, t) = ip n (s] x\q, t) as the induction hypothesis. Then we know that 
e n {x\ s)(p n (s] x) is a formal solution of the eigenfunction equation is s variables, and hence 

K^\u) x\q, t) = ^{s- x\q, t) f[ ^ , (5.23) 

as well as 

K (s;, M t) {u) Hs . ^ t) = ^ t) JJ (W^ g)°o {bM) 

by the symmetry if)(s',x\q,t) = i/;(s;x\q,q/t). By formula ( I5.24p with u = tx n+ i, the 
recurrence formula (I5.22p is rewritten in the form 

/ < i +\ _ TT ( tx n+i/xi] q)oo {qs n+1 /tsu q)^ 

1p n+ l{S,X\q,t) —II -. r ■; -. r 

(qx n+ i/Xi; gjoo (gs n+1 /Si; g)oo 

■ i^ s l^)(g Sn+1 /t) i^^(tx n+1 ) Vn(«; *)■ (5-25) 

By the symmetry ip n (s; x\q,t) = ip(x;s\q,t) = ip(x; s\q,q/t), the right-hand side is sym- 
metric with respect to exchanging x -H- s and t ■<->• q/t simultaneously. Hence we have 

ip n+ i{s;x\q,t) =tp n+1 (x;s\q,q/t) = ijj n+1 (x; s\q,t), (5.26) 

as desired, by using the symmetry of i/; n+ i(s;x\q,t) with respect to t ■<->■ g/t. 

The argument above, together with the recurrence by Jackson integrals in the previous 
section, provides a proof of duality and bispectrality of the formal power series 

f n (x;s\q,t) = e n (x;s)<p n (x;s\q,t) G e n (x; s)C[[aT Q+ ]][[ t <r Q +]] (5.27) 

which does not depend on the theory of Macdonald polynomials. 

Theorem 5.1. The sequence of formal power series ip n (s; x\q,t) (n = 1,2, . . .) satisfies 
the following recurrence relation by the q-difference operators : 

/ / i ^ TT [tXn+i/xi] q)oo (qs n+ i/tSi, q)^ 
ip n+1 (s;x\q,t) = \ \- — - — 

fj^ (qx n+ i/Xi; gjoo {qs n+1 /Si; q)^ 

■ K^\qs n+1 /t) K^™M(tx n+1 ) Ms; x\q, t), (5.28) 
where K^ x '^ q,t \u) is the q-difference operator defined by (I5.18P . 

□ 

Theorem 5.2. The formal power series (p n {x] s\q, t) and ip n (x; s\q,t) satisfy the duality 
relation 

<f n (x;s\q,t) = <f n (s;x\q,t), ip n (x; s\q,t) = ip n (s;x\q,t), (5.29) 
for n = 1, 2, . . .. Hence 

f n (x; s\q, t) = e n (x; s) ip n (x; s; q\q, t) 

i \ TT {QXj /xf, qjoo (qsj/s^qjoo , . . . . 

= e n {x;s) - — J — — - — J — — ip n (x;s\q,t) (5.30) 

i<T<j<n \1 x il tx ^ g)°° \1 s il ts ^ g)oo 

is a formal solution of the bispectral problem (14. ip for Ruijsenaars-Macdonald operators. 
Furthermore, ip n {x; s\q,t) is invariant under the change of parameters t <H- q/t. 
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□ 

In explicit terms, the recurrence relation (I5.25P means 

ip n +i(s; x\q,t) 

_ tt {tx n+1 /xj\ q)oo (qs n+1 /tSi\ q)^ 
(qxn+i/xi; g)oo (qs n+1 /si] g)<x> 

n 

■ J] (gW^) w (tan+iMr g E *= l/w ^(g - ^; g-^|?,t). (5.31) 

i=l 

This recurrence formula manifestly shows the symmetry of ^> n (s; i) with respect to 
exchanging x 4-> s and £ -h- q/t simultaneously 

6. Convergence of formal solutions 

6.1. Summary on formal solutions of the bispectral problem. In previous sec- 
tions, we investigated the joint bispectral problem 

n n 

D x (u)f(x; s) = f(x; s)]] (1 - us*), D s (u)f(x; s) = f(x; S )J] (1 - u Xi ), (6.1) 

i=l i=l 

in variables x = (xi,...,x n ) and s = (si, ...,s n ), and constructed an explicit formal 
solution 

f n (x; s\q, t) = e n (x; s) <^ n (x; s\q, t), 

<p n (x;s)= x-"s-"<Pw e C[[x- Q +]][[s- Q +]] (6.2) 

of this bispectral problem. Here we assume that e n (x; s) is (possibly multi- valued) a 
meromorphic function on TJ x T", satisfying the symmetry condition e n ( 
and the (/-difference equations 

T q , Xi (e n (x; s)) = e n (x;s)si/t n ~\ T g!Si (e n (x; s)) = e n (x; s)xi/t n ~ l (i = l,...,n). (6.3) 

We introduced another formal power series 

M^s\q,t)= Yl rt"^eC[[x-°1[[ S ^]] (6.4) 

such that 

Vn{x;s\q,t)= II - — J — r-7-^77 —tpn(x;s\q,t). 6.5 

This formal power series ip n (x; s\q,t) satisfies the initial conditions 

t) \ Xi+l/xi=0 (i =l,...,„-l) = !> S\q, t) \ Si+l/si=0 = 1, (6.6) 
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and remarkable symmetry relations 

ip n (x;s\q,t) = ip n (s;x\q,t), ip n (x; s\q,t) = ip n (x;s\q,q/t). (6.7) 
The basic object in our framework was the formal power series 

Pn (x;s\q,t) = Cn(0;s\q,t) J] {xj/x^ e C( S " Q +)[[x- Q +]], (6.8) 

9<=M„ l<«<j<" 

where 

" ( g £.> h (*.a-ei,.)t S y Sf ;g). 

c n (6;s\q,t)= \ \ II — . . 

A T-r (q~ e i' k+ ^ a > kiei ' a ~ ej ' a) qs i /ts i :q)e.. , 

By means of this p n (x; i), y2 n (x; s|g, £) and ^(^j s | g, t) are expressed as 

M*;*\Q,t)= II \ q8i i** q) r Pn{x-,s\q,t) (6.10) 
i<i<i<„ W s i/ rs *»9Joo 

and 

Vfe(*;«|g,t) = II t^t^% ^; a|g,t). (6.11) 

By the symmetry (16.71) . this formal power series ^ n (x] s\q, t) can be expressed in four 
ways: 

/ / i ,\ TT (q%j q)oo i I ,\ T r (qSj/tSi, q)oo i I ,\ 

= n ^^% ^;«ig,gA)= n f Sj { Si ' ,q \°° Pn(s-,x\<i,q/t). 

(6.12) 

6.2. Convergence of formal solutions. In view of symmetry, we will mainly use below 

the power series i/j n (x] s\q,t) so that 

f n (x; s\q, t) = e n (x; s) ip n (x; s\q, t) 

= e n {x;s) [I - — J — r - — —tfj n {x;s\q,t). (6.13) 

l<i<j<n W X 3/ tX i'> 1)°° (? S i/* S i5 g)oo 



From the initial conditions (I6.6p . we already know 

ip n {x;s\q,t) E C(s- Q +)[[x^ Q+ ]]nC(x- Q +)[[s- Q +]]. (6.14) 
As to the expansion 

Mx;s\q,t) = X ^M*)> e C( S - Q +), (6.15) 

the ^(s) are rational functions in (s 2 /si, . . . , s n /s n _i), regular at (s 2 /si, . . . ,s n /s n -i) = 
0, and have at most simple poles along 

Sj ./ S . = (1 < i < j < n; fc = 0, 1,2, . . .). (6.16) 

32 



On the other hand, i/j n (x; s\q,t) is expressed as 

ip{x;s\q,t) = j [ * Xuq ^°° p n (x;s\q,t) 

l<i<j<n W X i/^'^°o 

- n { j^t ( £ • (6 - 17) 

where 

p M (s) = ^ c n (0; S |g,t). (6.18) 

Note that these c n (#; s|g,£) may have multiple poles along 

Sj /si = q k (1 < % < j < n; k G Z). (6.19) 

We denote by C™ -1 the (n — l)-dimensional affine space with canonical coordinates 
z = (zi, . . . , -2 n -i), and define a holomorphic mapping tc : T™ — t- C™ -1 by 

7r(a) = (az/ai, a n /a n _i) for each a = (ai, . . . , a n ) G T™, (6.20) 

so that n*(zi) = x i+ i/xi (i = l,...,n), where n* : C n-i — y n^Ojn) denotes the 
pull-back by tt in the sense of sheaves of holomorphic functions. Similarly, for the s 
variables, we use the (n — l)-dimensional affine space C™ -1 with canonical coordinates 
w = (wi, . . . , w n -i) such that 7r*(iUi) = Sj+i/sj (i — 1, . . . , n — 1). 

In view of the singularity of p^s), we define an open subset D w C C™ -1 by 

D w = {w = (w 1 ,...,w n _ 1 )eCZ- 1 \w l ---w j ^ 1 <£q- z U{0} (l<i<j<n)}, (6.21) 

so that 

u-\D w ) = {s = ( Sl ,...,s n ) GT™ I Sj /s t £q- z (l<i<j<n)}. (6.22) 

For each r > we set 

U z (r) = {z = ( Zl , . . . , z n _i) G C? -1 | \ Zi \ < r (i = l,...,n - 1)}, 

B z (r) = {z=(z u ...,z n _ 1 )eC n z - 1 | \zi\<r (i = 1, . . . , n - 1)}, (6.23) 

so that 

7T- 1 ( J B z (r)) = {x = (x 1 ,...,x n )GT^ | < (l<i<j<n)}. (6.24) 

Proposition 6.1. For n = 2,3, . . we regard p n (x; s\q, t) as a formal power series in 
z = (zi, . . . , ;z n -i) with coefficients in 0(D W ): 

p n (x;s\q,t)= c n(9;s\q,t) J] ( Xj /x^ E 0(D w )[[z]] (6.25) 

8eM n l<i<i<n 

re — 2 

We set r = If?/^™ -1 if \q/t\ < 1, and r = It/g] i/ Ig/t] > 1. Then for any compact 
subset K C D w and for any r < r^, this series (16.251) is absolutely convergent, uniformly 
on B z (r) x K. Hence p n (x; s\q,t) defines a holomorphic function on U z (ro) x D w . 
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Note that c n (9; s\q,t) is a product of factors of the form 

(q l au:q) k ., 

q)k 

with (w,a) = (qsj/si,t/q) or (w, a) = (sj/si,q/t). 



(6.26) 



Lemma 6.2. Let a G C* &e a nonzero constant. For any compact subset L C C*\q z , 
there exists a positive constant Cl > such that, for any finite subset IcZ, 



1 — q L au 



q l u 



< C L max{|a|,l} 171 (u G L) 



In particular, 



(q l au;q) k 



{l l u;q)k 



< Cl max {\a\, l} k (u G L) 



(6.27) 



(6.28) 



for any k G N and I G Z. 



Proof. We take nonnegative integers M, iV G N such that \q\ + < \u\ < \q\~ for all 
u G L. Given a finite subset / C Z, we divide J into three parts / = I U I U J + by 
setting 



7_ = /n(-oo,-M-l], J = in [-M,N- 1], /+ = in [N,+oo). 
Suppose u G L. Since < 1 for all i > N, we have 

1 — g l aw 



n 



1 — (fli 



< 



fly 



< 



(—\q N au 


; \q\)oo 


{\q N u 


; |?|)oo 



(6.29) 



(6.30) 



Since < 1 for i < — M - 1, 



nl — (fern 
1 - 



| a |l'-IJjI^~VH 

i6/_ 



Iq ,_ V' u I 



< a 



(_| g M+l /aM 


; kl)oo 


(| g Af+l/ u 


; |?l)oo 



(6.31) 



Hence by using three continuous functions 



c+(u) 



(-\q N au 




<?|)oc 


(\q N u 


; |?l)oo 



, c_(«) 



(-|^+Va« 


; |g|)oo 


(| g M+l/ M 


; M)oc 



and 



co(m) = max 

JC[-M,AT-1] 



1 — q l au 



we estimate 



1 — q l au 



q % u 



< |a|' 7 'c_(u)co(u)c + (u). 



(6.32) 



(6.33) 



(6.34) 



Since |a|l 7 -l < |a| |71 if \a\ > 1, we obtain the estimate of Lemma by taking for Cl the 
maximum of the continuous function C-(u)cq(u)c + (u) on L. □ 
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Proof of Proposition \6.1\ Let K be any compact subset of D w . By the definition (13.31) . 
cn(0;s\q,t)= II (v/tf^r^ 

l<i<k<n (95 



l<i<j<k<n 



(gE.> fc («i,a e ^qs j /s i ;q)e iik 



' II 7 -0 — re- -o- ) / \ 0eM » ' 6 - 35 

l<t<j<k<n v ^ J/ "^'"i,k 

Suppose that |g/t| < 1. Then by Lemma [6.21 we see there exists a positive constant Ck 
such that 

\c n (e;s\q,t)\<C K n { jryr$^ U \t/q\^^ {se^\K)). (6.36) 
Hence 

6»GAf„ l<«<j<n 9eM n l<i<j<n U9M5IM..j 

~ " J4 n (K^-^/^hlgDoo (6 ' 37) 

if \xj/xi\ < \q/t\^~ l ~ 1 for all 1 < i < j < n. Hence for any r > such that r k < \q/t\ k ^ 1 
for k = 1, . . . , n — 1, the function series p n (x; s\q,t) is absolutely convergent, uniformly 

n — 2 

on B z (r) x i^. The condition above for r is equivalent to r < r , r = Ig/tl"- 1 - The case 
\q/t\ > 1 can be treated in a similar way. □ 

By Proposition I6.1[ the function 

#^M) = II tx^q)°° MX;SM (6 - 38) 

l<i<j<n 3 1 *' y/ 00 

is holomorphic on U z (r ) x D w . Hence, the Taylor expansion of i/j n (x; s\q,t) 

il> n (x;s\q,t) = X ~"M S ) e Op^IN] (6.39) 

in z variables is normally convergent in U z (ro) x D w , namely, absolutely convergent, 
uniformly on any compact subset of U z (r ) x D w . 

We already know that the expansion coefficients (/•* £ Q+) are rational functions 

in w = (S2/S1, ■ ■ ■ , s n /s n -i), regular at w = 0, and have at most simple poles along 
Sj/si = Wi- ■ 'Wj-i = q~ k ~ x (1 < i < j < n; k = 0, 1, 2, . . .). In order to eliminate these 
poles of the coefficients, we introduce the function 

F n (x;s\q,t)= J| (qx j /x i ;q) 00 (qs j /s i ;q) 00 ip n (x;s\q,t). (6.40) 

l<i<j<n 
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As the formal power series in z variables, the expansion coefficients are entire holomorphic 
functions in s variables: 

F n (x;s\q,t) = E x^F^s) G 0{C n w l )[[z}]. (6.41) 

On the other hand, this function F n (x; s\q,t) is holomorphic on U z {tq) x D w , and hence, 
for any compact subset K C D w , away from the divisors Sj/si G q z (1 < i < j < n), and 
for any r < ro, this Taylor expansion is absolutely convergent, uniformly on B z (r) x K. 
Since the maximum of \x~^\ on B z {r) is given by r^'^\ it means that 

E \ x ~"\ \w\ ^ E rM \\ F ^K < +°° ( 6 - 42 ) 

on B z (r) x where H-P^Hk- stands for the supremum norm on the compact set K with 
Ffj,(s) regarded as a function in w variables. 

Lemma 6.3. For any compact subset K C C™ _1 ; and for any r < ro, the Taylor expansion 
(I6.4ip of F n (x; s\q, t) in z variables is absolutely convergent, uniformly on B z (r) x K. 
Hence it defines a holomorphic function on U z (r ) x C™ -1 . 

Proof. Let p > be any irrational number, and set 

K p ={w = (w x , . . . , w n ^) G C^ 1 I H = \q\~ p (i = l,...,n-l)} (6.43) 

Then we have if p C D w , since |sj/si| = = |g| _ ^' _ ^ p ^ for any i,j with 

1 < * < i < n. Consider the corresponding closed polydisc in C™ _1 : 

B w (\q\-P) = { W = («; 1 ,... )Wn „ 1 )6C:- 1 | \ Wi \ < \q\- p (i = 1, . . . , n - 1)}. (6.44) 

Then for each holomorphic function F p (s) G (9(C™ -1 ) (/i G Q+), the maximum of its ab- 
solute values on B w {\q\~ p ) is attained on the Silov boundary K p , namely, | \F P \ \ Bw n q \- P \ = 
\\F /1 \\ K . This implies that, for any r < ro, 



E wi^wi < E r <M n^ik < +°°> ( 6 - 45 ) 

uniformly on B z (r) x .£?„,( |g|~ p ). Since p > can be taken arbitrarily large, the Taylor 
expansion (I6.41|) of F n (x; s\q,t) in z variables is absolutely convergent, on any compact 
subset in U z {r ) x C"" 1 . □ 

Proposition 6.4. As to the function F n (x; s\q,t) defined by (16.401) . its Taylor series 

F n (x;s\q,t) = £ ^ S -7 w eC[[^]][[^]] (6.46) 

is normally convergent in C™ -1 x C™ -1 . Hence, F n (x; s\q,t) is continued to an entire 
holomorphic function on C™ -1 x C™ -1 . 

Proof. We know that this Taylor series is normally convergent in U z (r ) x C™ _1 . From the 
symmetry F n (x; s\q,t) = F n (s; x\q, t), it is also normally convergent in C™ -1 x U w (ro). The 
domain of convergence of this power series contains both U z (r ) x C™ -1 and C™ -1 x U w (r ), 
and hence it must be the whole affine space C™ -1 x C™ _1 by the logarithmic convexity 
of the domain of convergence. In fact, consider the compact subset B z (a) x B w (b) for 
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arbitrary a, b > 0. Take sufficiently large c > so that a/c < r and b/c < r . Then we 
have 

a (s,ri b (s,u) < 1 (( a / c )<M( 6c ) + (ac)<*'">(&/c) <*•">) z, e Q + ), (6.47) 
and hence 

<^(E (a/c) M (bc)^\F», u \+ £ (acf^(b/c)^\F^\\ < +oo, (6.48) 

on 5 z (a) x 5^(6). □ 

Theorem 6.5. For the formal solution 

f n (x; s\q, t) = e n (x; s) <p n (x; s\q, t), <p n (x; s\q, t) G C[[ X - Q +]] [[ S - Q +]] (6.49) 

of the bispectral problem (16. ip for Ruijsenaars-Macdonald operators, introduce a formal 
power series F n (x; s\q,t) by setting 

<p n x,sq,t Yl 1 ^. <j ^ n (qx j /tx i ]q) 00 (qs j /ts i ]q) 00 ' 

Then, F n (x;s\q,t) represents a holomorphic function on C™ _1 x C™" 1 in the variable 
(z;w) = (zi, . . .,z n -i; wi, . . .,w n -t) with z { = x i+1 /xi, Wi = s i+1 /si (i = l,...,n-i), 
depending holomorphically on t e C* . Furthermore, it satisfies the symmetry conditions 

F n (x;s\q,t) = F n (s;x\q,t), F n (x;s\q,t) = F n (x;s\q,q/t). (6.51) 

□ 

For n = 2, F 2 (x; s\q,t) is expressed as 

qx 2 /txi, qs 2 /tsi_ 



F 2 (x;s\q,t) = (t; q) 00 (qx 2 s 2 /x 1 Si] q)^ 2 <f>i 
as we already remarked in Section 3, and by symmetry 



qx 2 S 2 /x lSl 



F 2 (x;s\q,t) = {q/t\q) 00 {qx 2 s 2 /x 1 s 1 \q) oo2 <t> 



tx 2 /x u ts 2 /s 1 _ , t 
qx 2 s 2 /xiSi ' y ' q/ 



(\t\ < 1) (6.52) 



(k/t|<l). (6.53) 



6.3. Principal specialization. We give a remark on the evaluation of ip n (x;s\q, t) at 
x = t s . By duality, this question is equivalent to knowing the value at s = t s . The 
recurrence formula ( 13. lip for s = t s reduces to a single term with v = because of the 
existence of the factor 

11 l^t- (•■«) 

l<i<j<n+l W S j/**'«M 

since (tsj/s^q)^ for j — i + 1 vanishes unless z/j = 0. Hence p n (x; t 5 \q, t) = 1 for all 
n = 1, 2, . . .. From 

? n (x;t%t)= TT 7^ = 1T!#. (6.55) 
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we obtain 

<p n (t s ;s\q,t) = ip n (x;t s \q,t) = JJ ■ ^ . 

According to the definition A3. 1 2j) . this implies a nontrivial summation formula: 
Theorem 6.6. Let \t\ > |g|~ (n ~ 2) . We have 

{q/t;q)oo tt (qSj/tShQ)oc 



(6.56) 



^2 s \ q -- 

eeM n 



t) £W 



n 



n 



(qsj/si;q) c 



(6.57) 



Proof. By Proposition 16. 1[ when |i| > |g| ( n 2 \ the left-hand side is normally convergent 
for Sj/Si q z (1 < i < j < n). □ 

7. Case n = 3 

7.1. Results. In this section, we present a direct method to check the structure of the 
divisor of the poles of p n (x; s\q, t) and the duality for the case n = 3, by applying several 
transformation and summation formulas for basic hypergeometric series. Note that the 
duality (16 ,7p can be stated as 



*\q,q/t)= J] Wr^ Pn(s-,x\q,t). (7.1) 



Theorem 7.1. We have 
p 3 (x;s\q,q/t) = ^ c 3(9; s 2 , s 3 \q,t)(x 2 / x 1 ) ei ' 2 (x 3 /x 1 ) dl ' 3 (x 3 /x 2 ) 02 > 3 

0eM< 3 ) 

(q/t;q)k(q/t;q) k (t;q) k (t;q) k 



E 



(g; q)k(qs 2 / Si; q)k(qs 3 / Si; q)k(qs 3 / s 2 ; q) k 



(qs 3 /t Sl ) k (tx 3 / Xl ) k (7.2) 



fc=0 

x II 201 fc+1 , ;q,tXjXi 
i<«<i<3 J/ 

T/iis manifestly shows that p 3 (x; s\q,q/t) has at most simple poles along the divisors 
Sj/Si = q~ k ~ x (1 < % < j < 3; k = 0, 1, 2, . . .). 



A proof will be given in Section 7.3. We can recast this into another form. 

p 3 (x;s\q,t) 



Theorem 7.2. We have 

(qSj/s^q) 



(p 3 (x,a\q,t)= Yl 

l<i<j<3 



(qSj/tSi;q) c 



^Mi##^(gx 3 ,3M3i) fc 



fc>0 



n 



(q;q)k(t;q)k 

(t) q) oo(9^ j S j I •EiSi] g)oo 

(qxj/txi] q) 0O (qs j /ts i ; q) c 



29\ 



qxj/txi, qsj/t 
qXjSj/ 



l<«<i<3 

which manifestly shows the duality (f 3 (x, s\q,t) = (p 3 (s,x\q,t). 



X'jSi 



q,qt 



(7.3) 



1*1 < 1) 



Proof. We can proceed in a completely parallel manner as (14.111) for n = 2, by using the 

□ 
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g-binomial theorem and Theorem 17.11 



There is yet another way to see the duality manifestly From Theorem 17.11 and the 
g-binomial theorem, we have 



n{qsj/ Si]q)oo . . 
— p 3 {x; s\q, q/t) 

l<i<j<3 (<w/ ts *> ( V°° 

= y (q/t; q )Mt; q) k (t; q) k (t; q) k ^j^H^^H 

x n ^/^M^^/s.qU (7 . 

\ij< 3 {& +x siitw)~ { ' ,%) { } 

= y (g/t; g ) fc ( g /t; g ) fc (t; g ) fc (t; g ) fc tf^tf 

x n ( C Vt ; gkj ( f t; (fa//^ wfa*)^^, 



which indicates the duality of the form stated in (17.11) . 



7.2. Some transformation formulas. For our proof of Theorem 17. 11 we prepare several 
transformation formulas. We use the notations used in [3]. 

Proposition 7.3. Let 9,r be nonnegative integers. We have the transformation formula 
for very well-poised series 



ill i 



r+9 W r+8 (a; q~\ q e af, a lf • • • , a n (f ) 1 , - (f ) * , (sfj * , - (sfj * ; q,z) (7.5) 
{aq,f 2 /q; q)e ^ g"°» a g//; g)m m w , - m w , , ^ 



Proof. Note that from the g-Saalschiitz summation formula [3], we have 



(//?) 



{af,f;q)e (q e q 2 /f 2 ,q e af;q)k{aq;q) 



2k 



(aq, PI q; q)e (t V f, q 9 aq; ?)*(«/; 9)2* 

(/, q 2k af;q) e -k 



(Plq,q 2k aq;q)e-k 

q 2k aq/f, q/f, q- 0+k 
q 2k aq, q 
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(7.6) 



3<?2 



By using this, we can proceed as follows: 



{afJ ' q)e xLHS 



(aqj 2 /q; q)t 

= >p (afJ;q)e (a,q~ 8 ,q e af;q) k (a u - ■ ■ ,a r ;q)k (aq/ jjjjjgfcl - aq 2k j, 
{^ Q (aq,f 2 /q;q) e (q,q- e q/f,q e aq;q) k (^,---,^;q) k (af;q) 2k l~ a 

E (fiq 2k af;q)e-k (a,q~ 9 ;q) k (oi, • ; ; , a r ; q)k (aq/ f} q)2k 1 - aq 2k , , , )k 
i , (P/q,q 2k aq;q) e _ k (q,q~°qyP;q) k ^,... ,3L;q) h {aq;q) 2k 1-a KqZ,I) 

\- \- (q 2k aq/ f,q/ f,q~ e+k ]q)e t (a,q~ e ;q)k (a u - ■ ■ ,a r ;g) k 
~ h t q2kaq ' 9 ' <r*»?IF\ q)t q (<z, <rV// 2 ; q) h (Jf, ■ • • , <?)* 

[aq; q) 2k I- a 

(aq/f,q/f,q~ 9 ;q)m m (a,q- m ,q m aq/f;q) k (a l ,--- ,a r ;q) k l -aq 2k k 



m 



n/ (ag,g,g-V// 2 ;g) m ' (q,q~ m f,q m aq;q) k . . . , f* ; i_ a 
(ag, g, q-°q 2 /f 2 ] q) r 

(afj;q)e 



z 



E{aq/f,q/f,q e ;g)m m , _ m m \ 
——————— g r+ 5^ r+4 (a; g , g aq/ f, a 1; ■ ■ • , a r ; g, 2) 



(aqj 2 /q; q)e 



x RHS. 



□ 



Lemma 7.4. Let 6 be a nonnegative integer. We have 



E{q/ f ) q j °g/ /j g)m m TTA / , , _ m 3 m +3 /, , % 
_ e 2/ r ^q 10 W 9 {a;b,c,d,e,f,g,q ; g, a q ^ /bcdefg) 

q q I J 1 a <?) <?Jm 



m>0 



y^y^ (q/f,q e ,aq/fg;q) 

^4^' (9.9"V// 2 ,a?/^;g)m 



x (g m J^9,aq/de;q) j ■ 
(q,aq/d,aq/e,q- m fg/a;q) j 4 3 



g i ,d,e,aq/bc 
aq/b, aq/c, q~ide/a ^' 



iVote £/iat i/izs /ioWs a/so w/ien 6 is defending on m. (In the proof of Theorem \ 7.1 
will consider that case b = q m aq/f.) 

Proof. Recall Exercise 2.20 (p. 53) in Gasper- Rahman [3]: 



i W 9 (a; 6, c, d, e, f, g, g n ; g, a 3 q n+3 /bcdefg) (7.9) 



(aq,aq/fg;q) n y> (g n , f,g,aq/de;q) j ■ 
(aq/f,aq/g;q) n j^(q,aq/d,aq/e,fgq- n /a;q)j 4 3 

40 



g J ,d,e,aq/bc 
aq/b, aq/c, deq~i /a' ' ^ 



Then we have 



LHS 



v^v^ (q/f,q ei,2 ,aq/f;q)m m 

k'oh( q > q ~ ei ' 2q2/f2 > aq] q)m9 

(aq,aq/fg;q) m (q~ m , f, g, aq/de; q) 



(7.10) 



(aq/ f, aq/g; q) m (q, aq/ d, aqj e, q~ m fg/ a; q) j 
RHS. 



q J 4h 



q i ,d,e,aq/bc 
aq/b, aq/c, q~ide/a 



q,q 



Here one should note that we have (q m ; q)j = when m < j, and one can exchange the 
order of the summations as £ m>0 V . >0 = £\ >0 £ m>0 = £ j>0 J2 m>i - □ 



Proposition 7.5. Let 6 be a nonnegative integer. We have 



, fl „ a/Jg \ q ioWb(a; q aq/f,c,d,e,f,af/e,q ;q,aq fcdf) 



m>0 



(q,q- e q 2 /f 2 ,aq;q) 7 



(e,/;g)« 



(eg//, P/q; q)e 



J2(aq 3 /cdf 



2 V. 



(c,d,f,af/e,q 6 ,q e f/e;q) 3 



(q, aq/c, aq/d, aq/e, q~ e+1 /e, q- e+1 /f; q)j 



X 5 04 



q J ,aq/cd,q/f,q d ] f,q ] e/a 
f,q^+ l /d,q-i+i/c,q°-ieq/f 



q,q 



(7.11) 



Proof. In this proof, we use the notations b = q m aq/f,g = af /e for simplicity of display. 
Use the Sears transformation [3] (2.10.4) twice, we have 



q~\d,e,f c 

f,!f, q-ide/a 
(aq/be, q~^d/a; q) 



q,q 



(aq/b,q ide/a;q)j 



^,e,%b 

aq —j be aq_ ' 
c ' " a ' d 



q,q 



(7.12) 



(aq/be, q j d/a;q) j ^ (d,c; q)j Uq/cdy^ 
(aq/b, q-ide/a; q)j (aq/c, aq/d; q)j 



q- j ^r j U- j ~. 
r^q-^q-^' 



q,q 



Use the g-Saalschiitz summation formula, then we have 



>p {g/f,g e ,aq/fg;q)m 



(g m ,aq/be;q)j (q 3 b/a;q) k 



m>j 



(q, q- 9 q 2 /f 2 , aq/g; q) m (q~ m fg/a, aq/b; q)j (q-Jbe/a; g), 



(g e+j ,q k q/f,aq/fg;q) m - j m _j 



(g/r) 



(g e q 2 /P;q)j ( a q/9;q)k^ j (q- e+j q 2 /P,q k aq/g,q;q) m -j 

i ,,, (g~ e ;g)j {qjpqh (af/g,q k f;q)e-j 



(q- e q 2 / P; q)j (aq/ g; q) k (P / q, q k aq/ g; q) d -j ' 
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(7.13) 



Hence from these and Lemma 17.41 we have 
LHS 



j>0 k>0 m>j 

(aq/be,dq~ j /a;q)j • 
X — : — —e - 



(q/f,q 9 ,aq/fg;q)m_ q m 



(q m ,f,g,aq/de;q) :i 



(q,q e q 2 /f 2 ,aq/g]q) m {q,aq/d,aq/e,q m fg/a]q) 3 



(d,c; q)j 



-(aq/cdy 



(aq/b,deq 3 /a;q)j (aq / c, aq / d; q) 

aq/ cd, q- J b/a, q~ 3 e/a\ q) k k 
(q, q-ibe/a, q~ j q/d, q~iq/c; q) k 

, (q~ 9 ;q)j (q/f;q)k (af/g,q k f;q)t 



^^(q/f 2 )^ (aq/cdy 

j>0 k>0 



(q~ e q 2 /f 2 ;q)j (aq/g;q)k (f 2 /q,q k aq/g;q)e- 



X 



(f,9,<m/de;q)j (dq J /a;q)j (d,c;q)j 
(q, aq/d, aq/e; q)j (deq~i/a; q)j (aq/c, aq/d; q)j 



(q- j ,ag/cd,q-- j e/a;q) k k 
(q, q~ j q/d, q~ j q/c; q) k 

(f, af/g;q) e 



(aq/gj 2 /q;q)e j 



J2(aq 3 /cdf 2 Y 



(c,d,f,g,q 9 ,q e g/a;q)j 



j>0 



(q,aq/c,aq/d } aq/e } q e gq/af,q 9 q/f;q)j 



X 5 04 

= RHS 



q 3 ,aq/cd,q/ f,q 9 3 f,q 3 e/a 
lf,q-i +1 /d,q-i+ l /c,q<>- 



q,q 



7.3. Proof of Theorem 17. 1L We specialize the variables a, b, c, d, e, /, g as 



a = 


q p s 2 /si, 






b = 


q- p+m ts 2 / Sl , 


aq/b 


= q^ m /t, 


c = 


qs 3 /ts!, 


aq/c 


= q~ p ts 2 /s 3 , 


d = 


q~ p s 2 /s 3 , 


aq/d 


= qsa/s!, 


e = 


qs 2 /ts 1 , 


aq/e 


= q~% 


f = 


q/t, 


aq/f 


= q~ p ts 2 /s 1 , 


g = 


q~ P , 


aq/g 


= qs 2 /s 1 , 



in the transformation formulas we have constructed above. 
Lemma 7.6. Let 6,p be nonnegative integers. We have (with \1.15 )) 
^ c 3 (0 -k,k,p-k; si, s 2 , s 3 \q, q/t) 

fc>0 

= c 3 (e,0,p;s u s 2 ,s 3 \q,q/t) 

x u W 13 (a; q~ e , q e af, c, d, e, /, g, (f ) 1 , (f ) 1 , - (f ) 1 ; q, t 2 ). 

Proof. Straightforward calculation. 

Proposition 17. 3[ 17.51 and Lemma 17.61 give us the following formula. 
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Proposition 7.7. Let 9,p be nonnegative integers. We have 
^2 c 3(9 -k,k,p-k;sx, s 2 , s 3 \q, q/t) 



k>0 



t e ( ( l/ t ,Q s 2/tsi;q)e tP {q/t, qs 3 /ts 2 ; q) p 



X 504 



(Q,QS 2 /s 1 ;q)e (q, qs 3 /s 2 ; q) p 
(q~ e ,q~ e s 1 /s 2 ;g) j (q~ p ,q~ p s 2 /s 3 ;q) j {q/t,qs 3 /ts 1 ;q) j 3j 
(q-H, q-Hs 1 /s 2 ; q)j (q~ p t, q~ p ts 2 /s 3 ; q) j (q, qs 3 /s 1 ; q)j 



t,t,q-i,q e -i +l /t,q p - j+l /t 



q/t, q~H Sl /s 3 , q e -i +l s 2 /s l ,qP-i+ 1 s 3 /s 2 
Now we are ready to state our proof of Theorem 17.11 



q,q 



(7.17) 



Proof of Theorem \7.1\ The coefficient of the monomial (x 2 /xi) (x 3 /x 2 ) p in the series 
p 3 (x; s\q, q/t) is J2k>o c '^ — k,k,p — k; si, s 2 , s 3 \q, q/t). On the other hand, it can be 
easily shown that the coefficient of the monomial (x 2 /xi) e (x 3 /x 2 ) p in the series on RHS 
of f)7.2p is given by the RHS of f)7.17p . Hence we have the equality (17. 2p . □ 



8. Family of commutative integral transformations 
We revisit the problem considered in [11] . 

Suppose g(y) is a joint eigenfunction of Ruijsenaars-Macdonald operators in n variables 

y = {yi, ■ ■ -,y n ) 

n 

Dy(u)g(y)=g(y)l[(l-ut n -Y') (8.1) 

with complex parameters A = (Ai, . . . , A„). Define a function f(x) in the same number 
of variables x = (x\, . . . , x n ) by an integral transformation of the form 

/<*>=/ n n. fcSSfc* »™ **>-> ■ (8 - 2) 



where dio{y) is a g-invariant measure on T™, c(x, y) = c(xi, . . . , x n , y\, . . . , y n ) satisfies the 
conditions 

T q , Xl c(x, y) = ac(x, y), T qm c(x, y) = a^c(x, y) (1 < % < n), (8.3) 

where a G C* is a parameter. One of the choice of such c(x, y) is 

r(T 7 a = („/..\X jj Oj^qyilsitx^q) yr e(qy j /x i ;q)6(qy J /ty i ;q) 
c { x,y) WV) LL e{qyi/tx , q) J < l^e( qyj /tx i ;q)e(q yj / yi ;qy 

where Sj = t n ~ l q Xt (i = 1, . . . ,n). Then by using the same argument as in [7J, we can 
conclude that we have 

n 

D%u)f(x) = f(x)H (1 - ut n -iq x *). (8.5) 
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Let t satisfies \t\ > 1, and fix r such that < r < 1. Consider a function f(x) = x x ip(x) 
with (p(x) being a holomorphic function in the variables {xijx\, . . . , x n /x n -i) defined on 
\x i+ i/xi\ < r (i — 1, . . . , n — 1). Let a G C* be a parameter, and set 

i>(z)=f ~.f 17-^-17 o^™ 1 ****? pi™ q }°° (s.e) 



tt (txj/yuq)^ (gyj/xug)^ . Myj/ty^g)^ ,, 
J-l {xj/y^q)^ (qyj/tx^q)^ 3 1 (tyj/y^q)^ 



x 

l<i<j'<n 

where the contours are defined by = with > a, > (z = 1, . . . ,n). 

Then -^(x) is a holomorphic function in the variables (a^/^i, . . . , x n /x n -i) on |a;i + i/xj| < 
\q/t\r (i — 1, . . . , n — 1). Since |t| > 1, our integration cycle is g-shift invariant. We define 
the integral transform (1(a) f)(x) of f(x) = x x ip(x) by setting (I(a)f) (x) = x x ip(x). 

Theorem 8.1. For any a, (5 e C* ; we have 

[£)*(«), 1(a)] =0, (8.7) 
[/(a),/(/3)] =0. (8.8) 

Proof. We have (18. 7p since J(a)(a; A pn(^; s|g, t)) is proportional to x x p n (x; s\q, t). Then 
dBZSD follows from dSHD- D 
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